-- Logs begin at Mon 2022-08-29 22:57:29 UTC, end at Tue 2022-08-30 00:13:59 UTC. -- Aug 29 23:43:12.784189 dv-cinder-855041-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:43:12.792133 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:43:12 2022] *** Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: nodename: dv-cinder-855041-2-iscsi Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: machine: x86_64 Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: clock source: unix Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: pcre jit disabled Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: detected number of CPU cores: 4 Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: current working directory: / Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:43:12.794904 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: your processes number limit is 47680 Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: your memory page size is 4096 bytes Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: detected max file descriptor number: 2048 Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: lock engine: pthread robust mutexes Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: thunder lock: enabled Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:43:12.795746 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:43:12.835500 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: Python main interpreter initialized at 0x55cec2f7d9c0 Aug 29 23:43:12.835500 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: python threads support enabled Aug 29 23:43:12.835500 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: your server socket listen backlog is limited to 100 connections Aug 29 23:43:12.835500 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:43:12.835965 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:43:12.835965 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: *** Operational MODE: preforking *** Aug 29 23:43:12.836201 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:43:12.836287 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: spawned uWSGI master process (pid: 112629) Aug 29 23:43:12.836431 dv-cinder-855041-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:43:12.837013 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: spawned uWSGI worker 1 (pid: 112630, cores: 1) Aug 29 23:43:12.837987 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: spawned uWSGI worker 2 (pid: 112631, cores: 1) Aug 29 23:43:12.838147 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:43:13.515117 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:43:13.539852 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:43:14.620681 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:43:14.620681 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: from cryptography.utils import int_from_bytes Aug 29 23:43:14.621350 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:43:14.621350 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: from cryptography.utils import int_from_bytes Aug 29 23:43:14.626735 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:43:14.626735 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: from cryptography.utils import int_from_bytes Aug 29 23:43:14.627247 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:43:14.627247 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: from cryptography.utils import int_from_bytes Aug 29 23:43:17.148658 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:43:17.149218 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:43:17.149443 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:43:17.149549 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:43:17.149910 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:43:17.150024 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:43:17.150024 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:43:17.150248 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:43:17.150432 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.150623 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:43:17.150787 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.150943 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:43:17.151103 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.151271 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.151438 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.151579 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.151751 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.151894 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152062 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152274 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152430 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152579 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152742 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.152911 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153063 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153205 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153363 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153537 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153694 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.153866 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154012 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855041-2-iscsi {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154159 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154308 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154449 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154618 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154776 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855041-2-iscsi {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.154933 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.155087 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.155240 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.155396 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.155846 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156008 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156193 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156358 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156512 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156725 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.156927 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.157146 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.157146 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.157511 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.157511 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.157882 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158114 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158329 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158487 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158630 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158774 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.158934 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.159089 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.159304 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160006 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160211 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160386 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160543 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160696 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160838 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.160988 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.161160 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.161318 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855041-2-iscsi {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.161464 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.161607 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.161751 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.162116 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.162279 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855041-2-iscsi {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.162498 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.162654 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.162876 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163043 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163186 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163353 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163532 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163694 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.163846 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164004 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164156 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164339 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164495 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164639 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164790 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.164944 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.165086 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.165372 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.165518 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.165729 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.165888 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166031 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166175 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166330 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166495 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166648 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166802 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.166952 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167094 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167261 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167407 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167554 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167719 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.167719 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168013 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168202 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168418 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168565 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168707 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.168707 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169066 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169286 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169444 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169444 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169724 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.169878 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170039 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170189 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170334 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170473 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170621 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170621 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.170912 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171068 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171223 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171223 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171519 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171669 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.171814 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172051 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172332 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172505 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172677 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172826 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.172986 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173141 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173296 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173458 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173621 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173777 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.173928 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174076 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174220 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174366 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174524 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174667 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174820 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.174820 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.175082 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.175082 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.175974 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176122 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176289 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176453 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176611 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176773 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.176917 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177078 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177224 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177369 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177523 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177687 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177834 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.177990 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178132 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178274 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178475 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178475 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178768 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.178913 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179057 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179204 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179368 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179525 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179667 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179823 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.179969 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180128 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180370 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180526 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180671 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180843 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.180995 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181139 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181303 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181460 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181602 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181755 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.181930 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182156 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182367 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182517 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182671 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182815 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.182973 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183120 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183279 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183431 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183585 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183734 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.183888 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184053 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184239 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184408 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184579 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184724 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.184870 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185029 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185174 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185329 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185482 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185635 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185780 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.185938 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186220 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186373 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186521 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186664 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186818 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.186986 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187150 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187294 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187444 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187757 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.187916 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188076 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188276 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188422 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188624 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188811 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.188987 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189130 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189273 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189418 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189581 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189737 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.189897 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190038 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190178 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190321 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190461 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190601 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190825 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.190978 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191124 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191266 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191399 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191546 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191684 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191823 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.191959 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192111 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192305 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192527 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192527 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192825 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.192972 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193125 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193270 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193530 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193530 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193807 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.193807 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194074 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194074 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194361 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194506 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194651 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194805 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.194945 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195095 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195237 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195388 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195535 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195678 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195822 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.195988 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.196133 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.196373 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.196519 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.196695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:43:17.196844 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197007 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197163 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197307 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197464 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197611 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197762 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.197920 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.198332 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.198477 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.198620 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.198828 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199000 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199147 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199289 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199505 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199655 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199798 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.199960 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200114 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200283 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200429 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200575 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200737 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.200894 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201117 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201263 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201442 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201600 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201744 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.201911 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202059 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202205 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202352 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202705 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.202879 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203028 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203188 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203344 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203493 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203641 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203801 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.203956 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204102 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204318 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204473 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204686 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204835 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.204981 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205124 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205427 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205582 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205726 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.205880 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.206027 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.206173 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.206815 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.206977 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207125 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207271 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207417 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207560 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207717 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.207872 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208032 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208199 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208333 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208488 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208640 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208789 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.208930 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209071 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209209 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209350 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209509 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209674 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209820 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.209953 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210043 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210132 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210223 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210303 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210388 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210468 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210546 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210624 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210712 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.210877 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211003 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211084 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211164 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211238 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211305 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211405 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211546 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211687 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211849 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.211999 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212125 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212315 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212474 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212617 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212835 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.212990 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213134 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213272 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213417 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213564 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213817 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.213961 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214103 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214242 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214393 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214545 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214706 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214849 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.214989 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215128 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215275 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215531 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215687 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215843 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.215998 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216147 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216316 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216482 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216637 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216780 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.216931 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217058 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217204 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217362 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217499 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217637 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217783 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.217921 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218070 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218224 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218370 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218513 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218655 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218807 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.218964 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219103 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219256 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219401 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219552 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219696 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219853 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.219986 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220119 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220353 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220486 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220619 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220766 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.220904 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221047 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221191 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221391 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221550 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221675 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221824 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.221986 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.222809 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.222967 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223125 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223269 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223406 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223544 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223682 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.223846 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224001 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224145 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224330 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224486 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224630 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224776 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.224938 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225098 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225251 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225393 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225393 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225651 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225809 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.225956 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226103 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226250 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226494 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226674 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226832 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.226978 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227121 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227251 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227395 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227561 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227712 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.227870 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228026 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228248 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228398 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228567 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228715 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.228859 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229007 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229217 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229365 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229533 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229680 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229827 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.229981 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230147 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230313 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230472 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230617 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230772 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.230919 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231063 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231231 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231381 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231528 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231677 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231826 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.231973 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232131 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232377 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232527 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232691 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232836 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.232981 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233135 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233284 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233431 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233582 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233727 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.233895 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234045 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234190 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234337 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234480 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234641 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234799 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.234930 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235073 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235220 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235366 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235523 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235692 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235852 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.235999 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236144 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236353 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236501 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236645 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236805 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.236956 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237100 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237239 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237353 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237466 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237605 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237717 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237836 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.237949 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238069 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238179 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238296 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238406 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238515 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238628 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238753 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.238897 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239015 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239125 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239305 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239421 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239543 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239655 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239766 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239766 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.239977 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240089 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240247 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240389 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240534 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240676 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240831 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.240986 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241106 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241227 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241348 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241472 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241644 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241770 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241883 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.241996 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242106 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242217 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242338 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242482 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242598 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242705 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242802 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.242905 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243016 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243290 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243408 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243524 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243634 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243754 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.243901 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244115 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244393 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244526 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244638 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244749 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244870 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.244983 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245093 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245216 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245327 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245436 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245560 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245681 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245804 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.245949 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246065 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246175 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246301 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246412 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246523 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246721 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.246849 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247024 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247150 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247340 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247490 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247638 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247784 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.247949 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248093 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248278 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248415 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248575 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248722 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.248887 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249030 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249174 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249315 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249482 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249631 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249788 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.249934 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250081 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250226 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250375 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250532 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250680 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250824 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.250968 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251113 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251288 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251454 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251613 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251773 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.251931 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252073 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252316 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252482 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252628 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252776 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.252924 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.253070 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.253810 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.253978 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.253978 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.254264 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.254407 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.254551 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.254551 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.254854 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255000 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255147 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255315 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255465 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255614 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255760 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.255914 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256070 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256238 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256387 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256554 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256704 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256704 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256975 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.256975 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.257257 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.257478 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.257641 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.257789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.257937 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258085 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258252 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258399 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258563 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258722 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.258869 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259030 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259187 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259347 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259569 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259737 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.259886 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260034 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260203 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260351 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260497 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260663 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260811 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.260960 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261118 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261266 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261413 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261570 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261728 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.261876 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262033 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262181 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262355 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262504 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262649 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262803 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.262955 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263169 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263332 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263480 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263636 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263783 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.263935 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264080 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264080 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264442 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264584 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264734 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.264882 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265032 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265191 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265338 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265488 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265648 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265806 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.265969 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.266117 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.266272 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.266420 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.266570 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.266771 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267034 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267204 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267365 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267512 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267720 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.267869 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.268036 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.268221 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.268370 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.268516 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.268661 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.269358 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.269507 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.269644 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.269789 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.269945 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270097 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270252 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270391 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270523 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270523 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270791 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.270935 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271094 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271261 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271426 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271581 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271726 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.271868 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272005 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272147 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272362 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272510 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272652 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272813 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.272970 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.273175 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.273322 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.273530 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.273679 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.273836 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274008 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274165 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274317 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274470 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274680 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.274896 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275042 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275185 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275339 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275480 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275633 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275800 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.275944 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276085 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276305 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276452 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276616 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276761 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.276919 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277060 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277200 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277344 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277506 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277652 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277797 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.277944 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278090 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278246 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278406 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278554 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278703 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278848 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.278995 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279143 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279304 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279451 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279597 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279748 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.279898 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280057 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280288 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280436 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280583 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280733 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.280893 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281046 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281184 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281328 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281472 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281615 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281773 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.281940 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282153 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282303 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282303 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282571 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282717 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.282874 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283029 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283175 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283327 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283472 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283689 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283849 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.283993 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.284137 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.284321 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.284566 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285279 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285371 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285441 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285515 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285598 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285722 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285821 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.285925 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286068 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286268 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286418 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286571 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286724 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.286875 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287019 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287160 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287301 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287454 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287596 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287737 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.287936 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288090 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288269 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288481 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288691 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288840 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.288983 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289126 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289269 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289425 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289572 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289767 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.289927 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290071 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290216 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290371 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290517 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290663 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290816 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.290973 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291118 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291279 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291436 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291583 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291729 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.291877 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292027 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292335 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292499 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292648 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292777 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.292924 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293086 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293235 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293392 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293538 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293683 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.293872 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294041 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294041 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294316 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294463 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294661 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294813 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294974 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.294974 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295247 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295394 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295540 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295701 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295850 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.295997 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.296143 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.296314 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.296460 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.296728 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.296880 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297026 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297173 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297321 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297470 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297470 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297761 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.297922 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298081 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298239 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298389 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298556 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298704 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.298858 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299009 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299151 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299308 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299449 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299608 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299752 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299962 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.299962 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.300805 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.300964 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301108 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301254 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301400 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301549 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301721 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.301863 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302006 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302006 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302342 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302664 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302814 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.302960 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303116 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303275 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303493 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303643 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303802 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.303949 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304095 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304322 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304502 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304660 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304809 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.304954 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305104 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305249 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305407 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305549 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305688 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305831 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.305990 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306137 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306238 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306238 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306463 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306607 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306759 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.306917 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307063 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307218 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307363 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307363 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307631 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307788 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.307938 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.308147 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.308336 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.308553 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.308702 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.308858 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309007 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309153 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309298 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309441 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309582 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309798 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.309986 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.310183 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.310363 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.310363 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.310726 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.310889 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311031 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311182 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311329 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311474 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311617 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311759 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.311918 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312063 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312233 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312391 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312538 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312680 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312838 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.312983 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313133 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313293 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313440 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313586 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313746 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.313894 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314042 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314042 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314313 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314460 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314621 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314765 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.314908 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.315048 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.315197 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.315362 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.315507 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.315679 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.316384 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.316384 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.316677 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.316839 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.316987 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317133 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317279 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317423 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317582 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317752 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.317899 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318048 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318260 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318421 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318569 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318726 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.318875 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319023 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319180 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319325 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319485 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319643 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319798 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.319956 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320100 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320337 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320500 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320645 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320789 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.320935 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321047 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321136 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321227 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321365 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321459 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321561 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321722 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321861 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.321999 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322088 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322185 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322331 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322474 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322636 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.322791 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323206 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323351 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323494 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323647 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323804 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.323957 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.324265 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.324438 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.324584 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.324730 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.324884 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325037 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325183 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325325 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325463 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325605 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325754 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.325900 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326054 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326197 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326343 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326504 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326710 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.326858 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327012 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327156 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327297 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327456 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327600 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327600 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.327870 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328017 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328161 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328415 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328573 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328702 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328848 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.328997 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329141 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329141 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329427 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329427 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329707 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329707 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.329989 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330147 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330296 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330437 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330584 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330739 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.330907 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331068 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331218 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331411 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331565 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331708 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.331875 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332025 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332296 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332444 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332591 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332716 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332873 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.332873 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333148 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333307 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333464 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333632 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333781 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.333940 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334096 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334242 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334389 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334551 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334710 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.334854 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335010 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335163 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335308 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335468 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335624 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335772 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.335919 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336069 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336242 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336464 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336613 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336796 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336944 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.336944 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337226 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337376 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337523 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337670 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337828 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.337988 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338149 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338308 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338457 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338591 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338737 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.338897 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339054 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339054 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339322 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339470 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339626 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339773 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.339934 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340080 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340272 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340439 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340586 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340745 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.340905 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341076 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341217 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341355 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341503 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341663 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341813 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.341960 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342109 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342257 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342420 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342572 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342721 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.342861 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.343023 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.343172 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.343621 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.343842 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344007 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344155 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344402 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344582 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344742 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.344891 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345036 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345188 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345345 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345503 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345651 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345799 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.345942 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346091 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346237 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346396 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346545 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346678 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346808 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.346961 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347106 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347238 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347378 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347519 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347650 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.347800 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348054 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348285 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348285 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348578 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348718 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.348851 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349002 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349157 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349157 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349419 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349419 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349708 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.349857 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350008 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350178 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350178 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350451 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350688 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350688 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.350961 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351106 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351252 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351396 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351396 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351675 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.351833 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352030 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352224 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352373 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352678 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352841 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.352976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.353286 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.353578 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.353748 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.353880 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.354029 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.354285 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.354505 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.354781 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.354950 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.355103 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.355251 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.355396 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.355730 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.355882 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356042 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356288 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356439 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356686 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356841 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.356991 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.357165 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.357317 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.357580 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.357749 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.357909 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358079 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358226 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358473 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358639 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358842 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.358996 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.359165 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.359368 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.359531 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.359679 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.359882 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.360038 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.360311 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.360485 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.360635 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.360913 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.361078 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.361224 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.361516 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.361669 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.361818 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.362111 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.362278 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.362445 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.363193 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.363361 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.363687 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.363833 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.364043 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.364376 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.364561 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.364683 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.364823 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365023 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365259 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365414 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365627 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365766 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.365989 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.366319 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.366455 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.366625 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.366845 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.366994 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.367252 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.367418 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.367579 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.367779 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.367941 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.368199 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.368350 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.368491 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.368862 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.369071 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.369229 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.369372 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.369653 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.369792 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.370042 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.370205 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.370358 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.370593 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.370745 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371009 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371161 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371319 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371572 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371736 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.371888 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.372044 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.372261 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.372491 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.372642 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.372924 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373074 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373231 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373412 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373538 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373735 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.373933 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.374093 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.374346 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.374503 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.374665 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.374912 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.375070 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.375237 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.375393 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.375537 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.375809 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376028 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376214 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376377 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376525 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376747 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.376899 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.377097 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.377251 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.377414 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.377651 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.377805 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.378106 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.379409 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.379564 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.379712 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.379851 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380000 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380148 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380382 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380564 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380564 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380830 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.380946 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381022 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381129 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381275 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381404 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381532 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381679 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381827 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.381827 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382088 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382235 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382394 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382394 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382675 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382834 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.382980 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383123 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383281 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383428 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383635 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383794 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.383934 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.384259 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.384409 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.384555 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.384684 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.384861 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385008 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385180 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385328 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385485 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385746 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.385906 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386054 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386202 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386348 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386496 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386656 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386803 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.386946 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387090 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387234 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387383 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387541 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387699 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387843 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.387998 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388144 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388345 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388521 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388668 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388823 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.388970 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389114 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389337 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389497 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389645 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389794 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.389946 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390101 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390266 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390411 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390566 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390713 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390857 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.390951 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391064 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391204 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391409 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391561 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391718 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.391877 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392023 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392203 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392366 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392524 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392524 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392815 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.392961 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393115 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393260 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393404 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393551 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393809 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.393963 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394120 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394327 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394478 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394625 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394625 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.394923 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395055 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395202 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395360 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395523 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395669 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395815 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.395962 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396109 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396292 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396453 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396609 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396759 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.396906 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.397052 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.397201 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.397545 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.397707 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.397859 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398008 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398112 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398245 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398393 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398536 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398692 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398834 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.398974 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399127 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399275 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399422 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399570 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399718 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.399865 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400030 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400197 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400345 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400494 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400640 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400807 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.400962 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401118 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401269 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401514 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401668 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401830 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.401976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402121 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402268 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402412 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402554 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402721 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.402869 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403029 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403175 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403322 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403470 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403628 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.403848 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404013 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404159 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404336 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404500 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404656 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404803 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.404951 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405100 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405227 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405391 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405533 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405681 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405830 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.405988 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406133 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406289 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406434 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406579 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406736 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.406948 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407098 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407262 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407411 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407558 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407707 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.407862 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408019 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408165 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408412 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408623 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408771 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.408932 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409089 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409241 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409389 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409580 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:43:17.409723 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409723 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.409723 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.410148 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.410339 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.410656 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.410996 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.411310 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.411626 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.411940 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.412278 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.412597 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.412914 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.413245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.413572 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.413881 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.414212 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.414531 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.414860 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.415180 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.415492 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.415827 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.416140 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.416482 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.416798 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.417114 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.417424 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.417749 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.418064 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.418379 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.418698 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.419022 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.419353 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.419682 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.419996 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.420354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.420687 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.421041 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.421355 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.421705 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.422037 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.422353 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.422670 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.422979 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:43:17.423226 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:43:17.565676 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO dbcounter [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Registered counter for database nova_api Aug 29 23:43:17.579698 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO dbcounter [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Registered counter for database nova_api Aug 29 23:43:17.587266 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_db.sqlalchemy.engines [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.594310 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writer thread running {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.601057 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.607897 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writer thread running {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.653447 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.context [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9efe90b-fc44-4963-9806-066476515edb(cell1) {{(pid=112631) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:43:17.657380 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:43:17.657909 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:43:17.660040 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:43:17.660970 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:43:17.661421 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:43:17.663524 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_concurrency.lockutils [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:43:17.665650 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO dbcounter [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Registered counter for database nova_cell0 Aug 29 23:43:17.666654 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.context [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9efe90b-fc44-4963-9806-066476515edb(cell1) {{(pid=112630) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:43:17.670127 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO dbcounter [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Registered counter for database nova_cell1 Aug 29 23:43:17.670678 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:43:17.671164 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:43:17.672828 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:43:17.673599 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:43:17.674049 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:43:17.676862 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:43:17.678998 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO dbcounter [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Registered counter for database nova_cell0 Aug 29 23:43:17.679420 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_db.sqlalchemy.engines [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.680939 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_db.sqlalchemy.engines [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.685040 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO dbcounter [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Registered counter for database nova_cell1 Aug 29 23:43:17.688642 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writer thread running {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.688983 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writer thread running {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.692880 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.695290 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.700326 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writer thread running {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.706323 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writer thread running {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.838814 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO dbcounter [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Registered counter for database nova_cell0 Aug 29 23:43:17.848919 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG oslo_db.sqlalchemy.engines [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.852885 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO dbcounter [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Registered counter for database nova_cell0 Aug 29 23:43:17.854929 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writer thread running {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:17.862306 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:43:17.870716 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writer thread running {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:43:18.317992 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: WARNING keystonemiddleware.auth_token [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:43:18.331985 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: WARNING keystonemiddleware.auth_token [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:43:18.336129 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: WARNING keystonemiddleware.auth_token [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:43:18.343520 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: WARNING keystonemiddleware.auth_token [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:43:18.689252 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: WARNING keystonemiddleware.auth_token [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:43:18.696340 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: WARNING keystonemiddleware.auth_token [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:43:18.701892 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cec2f7d9c0 pid: 112630 (default app) Aug 29 23:43:18.704016 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:18.705278 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001862 Aug 29 23:43:18.705689 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Mon Aug 29 23:43:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:43:18.712656 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: WARNING keystonemiddleware.auth_token [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:43:18.718914 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: WARNING keystonemiddleware.auth_token [None req-61e80c5c-8787-4917-a627-5cc22c8f59a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:43:18.724554 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cec2f7d9c0 pid: 112631 (default app) Aug 29 23:44:47.957372 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:47.958344 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 29 23:44:47.958748 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:47.972207 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_api:SELECT=3 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:47.973942 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_cell1:SELECT=3 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:47.974938 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_cell0:SELECT=3 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:47.976059 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:48.887958 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-61082ad7-8978-41da-b4e9-30002cd03440 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:48.923404 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-61082ad7-8978-41da-b4e9-30002cd03440 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957041 Aug 29 23:44:48.924291 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 23:44:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:51.338788 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:51.339781 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-2c81f0bb-1a34-47d3-a3ef-56a485970247 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 29 23:44:51.340372 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:51.809218 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-8c698eff-bec5-4cbc-887a-2bbdd478c27c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:51.924569 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-8c698eff-bec5-4cbc-887a-2bbdd478c27c admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.576852 Aug 29 23:44:51.925408 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:51.940507 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_api:SELECT=3 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:51.941649 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_cell1:SELECT=3 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:51.942468 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_cell0:SELECT=3 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:51.943268 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:52.157343 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-2e3c34bf-8e1c-40a0-979d-0af891298521 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:52.287727 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-2e3c34bf-8e1c-40a0-979d-0af891298521 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353467 Aug 29 23:44:52.288301 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 23:44:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:54.771929 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-8c698eff-bec5-4cbc-887a-2bbdd478c27c admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:54.773016 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-8c698eff-bec5-4cbc-887a-2bbdd478c27c admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 29 23:44:54.773721 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:55.552663 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-3f2d616d-3131-40e3-9129-1e2c9e9b645b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:55.668649 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-3f2d616d-3131-40e3-9129-1e2c9e9b645b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.888295 Aug 29 23:44:55.669648 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:55.682968 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-c36e3759-4732-40d1-af64-752b6b257ad6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:55.797801 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-c36e3759-4732-40d1-af64-752b6b257ad6 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119258 Aug 29 23:44:55.799306 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 23:44:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:58.298751 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-3f2d616d-3131-40e3-9129-1e2c9e9b645b admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:58.300116 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-3f2d616d-3131-40e3-9129-1e2c9e9b645b admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 29 23:44:58.300116 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:58.730200 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-591b68cc-cf51-45b9-88b4-33c648f7da5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "name": "ds1G", "ram": 1024, "id": "d2"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:58.883619 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-591b68cc-cf51-45b9-88b4-33c648f7da5d admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.577095 Aug 29 23:44:58.891103 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:44:58.897244 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-61c64c3c-3cdb-41db-af9f-8f66c1c480bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:58.972444 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-61c64c3c-3cdb-41db-af9f-8f66c1c480bd admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079109 Aug 29 23:44:58.973027 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 23:44:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:01.442187 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-591b68cc-cf51-45b9-88b4-33c648f7da5d admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:01.446792 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-591b68cc-cf51-45b9-88b4-33c648f7da5d admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004910 Aug 29 23:45:01.447478 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:01.929132 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-8929d503-6fcf-453f-809a-3dc66b0f83d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "name": "ds2G"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:02.041019 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-8929d503-6fcf-453f-809a-3dc66b0f83d5 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.584451 Aug 29 23:45:02.041969 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:02.054935 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-1ae42ef7-f721-42e3-a1fc-d487400d7e92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:02.135531 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-1ae42ef7-f721-42e3-a1fc-d487400d7e92 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084277 Aug 29 23:45:02.152898 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 23:45:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:04.597630 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-8929d503-6fcf-453f-809a-3dc66b0f83d5 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:04.598636 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-8929d503-6fcf-453f-809a-3dc66b0f83d5 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Aug 29 23:45:04.599043 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:05.051481 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "swap": 0}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:05.153337 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.547935 Aug 29 23:45:05.153996 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:45:05.166294 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-aff262bb-596d-40b8-b00a-024ece4ce1fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:05.238010 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-aff262bb-596d-40b8-b00a-024ece4ce1fc admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075280 Aug 29 23:45:05.238813 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 23:45:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:45:07.686351 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:07.687298 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 29 23:45:07.687700 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:08.225394 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-e8ed3388-a7a4-4e92-bae9-8e10badf007a admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:08.250272 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-e8ed3388-a7a4-4e92-bae9-8e10badf007a admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.550529 Aug 29 23:45:08.250820 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 23:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:10.925986 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:10.927076 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-36a241d6-cdb1-416a-ab1b-f55e467cc4bc admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 29 23:45:10.927441 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:11.404459 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-ccfb6dfa-517a-48bc-adcc-6e88ee193c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "disk": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:11.479685 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-ccfb6dfa-517a-48bc-adcc-6e88ee193c90 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.545658 Aug 29 23:45:11.480259 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:11.494165 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-0c85d637-8992-437c-a1db-705778fec8a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:11.569421 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-0c85d637-8992-437c-a1db-705778fec8a0 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078785 Aug 29 23:45:11.569924 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 23:45:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:45:14.014135 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-ccfb6dfa-517a-48bc-adcc-6e88ee193c90 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:14.017371 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-ccfb6dfa-517a-48bc-adcc-6e88ee193c90 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 29 23:45:14.017371 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:14.453478 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-54aeaed7-e5af-4f67-b744-8ed4a06d9c9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:14.520530 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-54aeaed7-e5af-4f67-b744-8ed4a06d9c9e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.490636 Aug 29 23:45:14.521095 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:14.534576 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-b1ef9d59-b623-4ae5-b95f-36965e4fd141 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:14.650724 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-b1ef9d59-b623-4ae5-b95f-36965e4fd141 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120915 Aug 29 23:45:14.651313 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 23:45:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:17.075355 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-54aeaed7-e5af-4f67-b744-8ed4a06d9c9e admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:17.077011 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-54aeaed7-e5af-4f67-b744-8ed4a06d9c9e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002421 Aug 29 23:45:17.077414 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:17.585522 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-4e60b0a3-64cb-4285-909c-861728261cca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3", "swap": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:17.663069 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-4e60b0a3-64cb-4285-909c-861728261cca admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.578637 Aug 29 23:45:17.670602 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:45:17.678834 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-fff9253b-6b85-4905-bb6e-70665e3c8c29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:17.786239 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-fff9253b-6b85-4905-bb6e-70665e3c8c29 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114039 Aug 29 23:45:17.804203 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 23:45:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:45:20.302936 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-4e60b0a3-64cb-4285-909c-861728261cca admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:20.303862 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-4e60b0a3-64cb-4285-909c-861728261cca admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 29 23:45:20.309563 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:20.763170 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-6268429b-270f-4256-afe8-320bf6624795 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "id": "4"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:20.769433 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:20.866320 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-6268429b-270f-4256-afe8-320bf6624795 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.555310 Aug 29 23:45:20.867158 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:20.880811 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-25f047cb-8477-4473-8b00-856339a3e962 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:20.975220 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-25f047cb-8477-4473-8b00-856339a3e962 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099429 Aug 29 23:45:20.975913 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 23:45:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:23.417689 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-6268429b-270f-4256-afe8-320bf6624795 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:23.418712 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-6268429b-270f-4256-afe8-320bf6624795 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 29 23:45:23.419337 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:45:23.910227 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:23.916032 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:23.968955 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543080 Aug 29 23:45:23.970243 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 23:45:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:23.987505 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-e9a53bbd-6912-4aa4-8dbc-97937e45f1f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:24.092997 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-e9a53bbd-6912-4aa4-8dbc-97937e45f1f5 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113412 Aug 29 23:45:24.093909 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 23:45:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:44.294934 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:44.295866 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 29 23:45:44.296291 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:44.307603 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:44.712689 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-fe2727f2-8589-4c55-b5b1-6be28fc9fc2d admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:44.750696 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-fe2727f2-8589-4c55-b5b1-6be28fc9fc2d admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447590 Aug 29 23:45:44.751257 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 23:45:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:45:45.846140 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.847145 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-b0d38738-a21c-4987-86d0-143d6a413e48 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 29 23:45:45.847546 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:46.436166 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-1ce45a50-d3fc-449b-baad-6b1ce708e610 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:46.442584 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.wsgi [None req-1ce45a50-d3fc-449b-baad-6b1ce708e610 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-1ce45a50-d3fc-449b-baad-6b1ce708e610 admin admin] Request method failure captured: Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept: application/json Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept-Encoding: gzip, deflate Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Connection: keep-alive Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Content-Length: 0 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Host: 10.222.0.90 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-System-Scope: None Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: User-Agent: python-novaclient Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Auth-Token: gAAAAABjDU-phMbqzJwdtK5m4cdwNoyekQ9-YGtsUwCBa0HGscSNKpKSctt_J5bOG3uCXjTDScpcjdFE9RCcHUpfMuIbCaO9DE4ISt0RfQQr8lU9-fFW3J8aUrKd_9vqdxfcrVPSEXO65TyJ94K-9DjI0wVmTbDDsiKaostUZrLqVNIR8id6UjY Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Id: None Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Name: None Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Identity-Status: Confirmed Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Is-Admin-Project: True Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Id: default Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Name: Default Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Name: admin Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Role: member,admin,reader Aug 29 23:45:46.445915 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Roles: member,admin,reader Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant: admin Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Name: admin Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User: admin Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Id: default Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Name: Default Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Name: admin Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: method: > Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: exception: Flavor 42 could not be found. Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: action_args: {'id': '42'} Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:46.447593 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:46.448594 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.449953 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-1ce45a50-d3fc-449b-baad-6b1ce708e610 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:46.451571 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-1ce45a50-d3fc-449b-baad-6b1ce708e610 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.450495 Aug 29 23:45:46.451571 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:46.458483 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-aa0d96fe-051e-428d-8cb2-822dd76d73bf admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:46.481218 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-aa0d96fe-051e-428d-8cb2-822dd76d73bf admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026917 Aug 29 23:45:46.481776 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:45:46.492424 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-2da648fa-f2bc-4016-831d-63204c27fe7c admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:46.515252 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-2da648fa-f2bc-4016-831d-63204c27fe7c admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026339 Aug 29 23:45:46.515813 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:45:46.531799 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-18bbaef5-6b71-4915-bedd-573fdbdb8fdd admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:46.538008 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.wsgi [None req-18bbaef5-6b71-4915-bedd-573fdbdb8fdd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-18bbaef5-6b71-4915-bedd-573fdbdb8fdd admin admin] Request method failure captured: Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept: application/json Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept-Encoding: gzip, deflate Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Connection: keep-alive Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Content-Length: 0 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Host: 10.222.0.90 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-System-Scope: None Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: User-Agent: python-novaclient Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Auth-Token: gAAAAABjDU-phMbqzJwdtK5m4cdwNoyekQ9-YGtsUwCBa0HGscSNKpKSctt_J5bOG3uCXjTDScpcjdFE9RCcHUpfMuIbCaO9DE4ISt0RfQQr8lU9-fFW3J8aUrKd_9vqdxfcrVPSEXO65TyJ94K-9DjI0wVmTbDDsiKaostUZrLqVNIR8id6UjY Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Id: None Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Name: None Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Identity-Status: Confirmed Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Is-Admin-Project: True Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Id: default Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Name: Default Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Name: admin Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Role: member,admin,reader Aug 29 23:45:46.541311 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Roles: member,admin,reader Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant: admin Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Name: admin Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User: admin Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Id: default Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Name: Default Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Name: admin Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: method: > Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: exception: Flavor 42 could not be found. Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: action_args: {'id': '42'} Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:46.542695 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:46.543536 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:46.544929 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-18bbaef5-6b71-4915-bedd-573fdbdb8fdd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:46.546183 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-18bbaef5-6b71-4915-bedd-573fdbdb8fdd admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014608 Aug 29 23:45:46.546183 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 23:45:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:47.531791 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-2da648fa-f2bc-4016-831d-63204c27fe7c admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:47.532849 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-2da648fa-f2bc-4016-831d-63204c27fe7c admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Aug 29 23:45:47.533246 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:48.084196 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-0b0252b3-c684-43ae-ae1a-dd9bd3705a25 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:48.089871 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.wsgi [None req-0b0252b3-c684-43ae-ae1a-dd9bd3705a25 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-0b0252b3-c684-43ae-ae1a-dd9bd3705a25 admin admin] Request method failure captured: Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept: application/json Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept-Encoding: gzip, deflate Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Connection: keep-alive Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Content-Length: 0 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Host: 10.222.0.90 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-System-Scope: None Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: User-Agent: python-novaclient Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Auth-Token: gAAAAABjDU-rcggv_DHcTIewci2SHZnvJgP3amdiHt4V_boAXDP9dHJomnjf-py89pG0LtXWeWibYd4jOtW3lsJW4Uv28q4hv4e4R9sL0ULB9Z2gDfLC4XY5UcN8EQRtkEN9Bmoky7IY0Gcapw8wxHHDTsDdS0drEsKxWm1EUUj2Ub4LCD7rSl4 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Id: None Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Name: None Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Identity-Status: Confirmed Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Is-Admin-Project: True Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Id: default Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Name: Default Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Name: admin Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Role: member,admin,reader Aug 29 23:45:48.091354 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Roles: member,admin,reader Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant: admin Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Name: admin Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User: admin Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Id: default Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Name: Default Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Name: admin Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: method: > Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: exception: Flavor 84 could not be found. Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: action_args: {'id': '84'} Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:48.092793 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:48.093587 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.095208 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-0b0252b3-c684-43ae-ae1a-dd9bd3705a25 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:48.096344 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-0b0252b3-c684-43ae-ae1a-dd9bd3705a25 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.418954 Aug 29 23:45:48.096344 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 23:45:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:45:48.103371 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-a92a2446-7279-40be-9793-7d1328573464 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:48.119376 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-a92a2446-7279-40be-9793-7d1328573464 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019533 Aug 29 23:45:48.119940 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:48.130615 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-a154c4a7-da8c-4177-881a-df6ba98d0b4e admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:48.147066 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-a154c4a7-da8c-4177-881a-df6ba98d0b4e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020015 Aug 29 23:45:48.147623 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:48.158993 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-6fa06230-1c87-4c5a-97b8-7f2a9b4f9b1f admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:48.164481 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.wsgi [None req-6fa06230-1c87-4c5a-97b8-7f2a9b4f9b1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-6fa06230-1c87-4c5a-97b8-7f2a9b4f9b1f admin admin] Request method failure captured: Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept: application/json Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept-Encoding: gzip, deflate Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Connection: keep-alive Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Content-Length: 0 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Host: 10.222.0.90 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-System-Scope: None Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: User-Agent: python-novaclient Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Auth-Token: gAAAAABjDU-rcggv_DHcTIewci2SHZnvJgP3amdiHt4V_boAXDP9dHJomnjf-py89pG0LtXWeWibYd4jOtW3lsJW4Uv28q4hv4e4R9sL0ULB9Z2gDfLC4XY5UcN8EQRtkEN9Bmoky7IY0Gcapw8wxHHDTsDdS0drEsKxWm1EUUj2Ub4LCD7rSl4 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Id: None Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Name: None Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Identity-Status: Confirmed Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Is-Admin-Project: True Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Id: default Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Name: Default Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Name: admin Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Role: member,admin,reader Aug 29 23:45:48.165976 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Roles: member,admin,reader Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant: admin Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Name: admin Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User: admin Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Id: default Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Name: Default Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Name: admin Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: method: > Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: exception: Flavor 84 could not be found. Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: action_args: {'id': '84'} Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:48.167496 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:48.168403 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:48.169544 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-6fa06230-1c87-4c5a-97b8-7f2a9b4f9b1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:48.170557 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-6fa06230-1c87-4c5a-97b8-7f2a9b4f9b1f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012784 Aug 29 23:45:48.170557 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 23:45:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:49.202530 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-a154c4a7-da8c-4177-881a-df6ba98d0b4e admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:49.204383 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-a154c4a7-da8c-4177-881a-df6ba98d0b4e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 29 23:45:49.205046 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:49.749551 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-845be5f1-8c52-49e1-904d-a1da981dcf3d admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:49.755250 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.wsgi [None req-845be5f1-8c52-49e1-904d-a1da981dcf3d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-845be5f1-8c52-49e1-904d-a1da981dcf3d admin admin] Request method failure captured: Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept: application/json Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Accept-Encoding: gzip, deflate Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Connection: keep-alive Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Content-Length: 0 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Host: 10.222.0.90 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Openstack-System-Scope: None Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: User-Agent: python-novaclient Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Auth-Token: gAAAAABjDU-tbMH7zRbb-ptbzM307-J4LKBv3SqG4EiP3TX3RUQs8eXpTp_ONE-70BAkeI55ZpmoMOBJSfuQNIC9Rpz-p4S8hSNwbCuvNaDF5FYirvBw747DtI7jYxL0iGvApbb6aZTyxTEK8RaAqSu2Q32L1ULosApgRja88TQCExyqzlIcfFE Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Id: None Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Domain-Name: None Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Identity-Status: Confirmed Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Is-Admin-Project: True Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Id: default Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Domain-Name: Default Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Project-Name: admin Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Role: member,admin,reader Aug 29 23:45:49.756789 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Roles: member,admin,reader Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant: admin Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-Tenant-Name: admin Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User: admin Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Id: default Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Domain-Name: Default Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: X-User-Name: admin Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: method: > Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: exception: Flavor 451 could not be found. Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: action_args: {'id': '451'} Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:49.758267 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:49.759137 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.760382 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-845be5f1-8c52-49e1-904d-a1da981dcf3d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:49.761628 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-845be5f1-8c52-49e1-904d-a1da981dcf3d admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408714 Aug 29 23:45:49.761628 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:45:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:45:49.768599 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-6f677c2f-6f3c-4ffd-86e9-0e891f9d4ac1 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:49.783892 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-6f677c2f-6f3c-4ffd-86e9-0e891f9d4ac1 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019637 Aug 29 23:45:49.784461 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:49.794226 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:49.809234 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018556 Aug 29 23:45:49.809792 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 23:45:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:49.819770 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-4d847415-b645-4af9-a90a-209adc1efe43 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:49.825177 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.wsgi [None req-4d847415-b645-4af9-a90a-209adc1efe43 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-4d847415-b645-4af9-a90a-209adc1efe43 admin admin] Request method failure captured: Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept: application/json Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Accept-Encoding: gzip, deflate Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Connection: keep-alive Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Content-Length: 0 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Host: 10.222.0.90 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-Api-Version: compute 2.90 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Openstack-System-Scope: None Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: User-Agent: python-novaclient Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Auth-Token: gAAAAABjDU-tbMH7zRbb-ptbzM307-J4LKBv3SqG4EiP3TX3RUQs8eXpTp_ONE-70BAkeI55ZpmoMOBJSfuQNIC9Rpz-p4S8hSNwbCuvNaDF5FYirvBw747DtI7jYxL0iGvApbb6aZTyxTEK8RaAqSu2Q32L1ULosApgRja88TQCExyqzlIcfFE Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Id: None Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Domain-Name: None Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Identity-Status: Confirmed Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Is-Admin-Project: True Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Id: default Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Domain-Name: Default Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Project-Name: admin Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Role: member,admin,reader Aug 29 23:45:49.826932 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Roles: member,admin,reader Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7ebb01ff13ea4a259b137c01cbe21104", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7ebb01ff13ea4a259b137c01cbe21104"}]}] Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant: admin Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Id: 7ebb01ff13ea4a259b137c01cbe21104 Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-Tenant-Name: admin Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User: admin Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Id: default Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Domain-Name: Default Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Id: 873994140e0a49f3a009fec6e79331a1 Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: X-User-Name: admin Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: method: > Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: exception: Flavor 451 could not be found. Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: action_args: {'id': '451'} Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:45:49.829283 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:49.830245 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: ERROR nova.api.openstack.wsgi Aug 29 23:45:49.831513 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-4d847415-b645-4af9-a90a-209adc1efe43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:45:49.832749 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-4d847415-b645-4af9-a90a-209adc1efe43 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012064 Aug 29 23:45:49.832749 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:45:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:50.829963 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:50.830980 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 29 23:45:50.831372 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:51.382607 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-82569d0d-d5ef-4d70-8318-6d8e9d5a5c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:51.490787 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-82569d0d-d5ef-4d70-8318-6d8e9d5a5c27 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.515766 Aug 29 23:45:51.491345 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 23:45:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:52.505485 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:52.506487 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 29 23:45:52.506878 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:53.038876 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-037d9875-937e-4e98-ab70-19e367387e36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:53.117611 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-037d9875-937e-4e98-ab70-19e367387e36 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469972 Aug 29 23:45:53.118161 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 23:45:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:54.126858 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:54.127910 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002864 Aug 29 23:45:54.128352 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:54.668496 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-46e671cc-2f05-48f5-a0b9-71024a6ee30f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:54.754036 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-46e671cc-2f05-48f5-a0b9-71024a6ee30f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.486862 Aug 29 23:45:54.754588 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 23:45:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:45:55.755747 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:55.756831 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 29 23:45:55.757229 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:56.293152 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-50968595-2943-4f5e-90b9-24626fe28d5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:45:56.365082 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-50968595-2943-4f5e-90b9-24626fe28d5d admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.468297 Aug 29 23:45:56.365633 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 23:45:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:45:57.360836 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:57.361837 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Aug 29 23:45:57.362231 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:57.902870 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-93f52c3b-99bc-442a-b4da-f1899567f783 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:57.925485 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-93f52c3b-99bc-442a-b4da-f1899567f783 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.426816 Aug 29 23:45:57.926039 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Mon Aug 29 23:45:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:46:52.957666 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:52.958708 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-af352e8d-cdb3-4d1e-b431-19c9a0c0c165 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 23:46:52.959112 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 23:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:46:52.970292 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:53.367486 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-bca63c7d-f54a-4f9b-8b36-b400e914a133 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:53.388037 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-bca63c7d-f54a-4f9b-8b36-b400e914a133 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422931 Aug 29 23:46:53.388597 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 23:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:46:53.411234 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG dbcounter [-] [112631] Writing DB stats nova_api:SELECT=14 {{(pid=112631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:53.415017 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ed718660-7b88-41ee-acfc-ea5678ffb3da admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:53.422978 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ed718660-7b88-41ee-acfc-ea5678ffb3da admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013236 Aug 29 23:46:53.423528 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1283 bytes} [Mon Aug 29 23:46:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:46:53.435620 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-2bd19944-e7f2-4ed2-a09e-e1a45bae7ee8 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:53.443726 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-2bd19944-e7f2-4ed2-a09e-e1a45bae7ee8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011765 Aug 29 23:46:53.444284 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1286 bytes} [Mon Aug 29 23:46:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:46:53.457823 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:53.465582 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012093 Aug 29 23:46:53.466047 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1286 bytes} [Mon Aug 29 23:46:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:46:53.478652 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-e8415288-eaa8-44c1-9219-5fedca2ca5d8 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:46:53.486467 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-e8415288-eaa8-44c1-9219-5fedca2ca5d8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011438 Aug 29 23:46:53.487007 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1283 bytes} [Mon Aug 29 23:46:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:50:07.188857 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:07.189859 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 29 23:50:07.190262 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:50:07.337277 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_api:SELECT=6 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:07.517891 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:07.521915 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:07.522385 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:07.522808 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:07.523520 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:07.523962 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:07.524403 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:07.557785 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-76187382-1988-460e-a1c6-5f7b6c353d20 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.222018 Aug 29 23:50:07.558350 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 36/70] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:50:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:50:08.413260 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:08.414303 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 29 23:50:08.414697 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:50:08.613016 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:08.616482 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:08.616953 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:08.617375 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:08.618076 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:08.618519 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:08.618927 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:08.638589 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-54a5ec2b-774c-4ae5-add4-d0ca61e18a62 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079422 Aug 29 23:50:08.639147 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 37/72] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:50:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:50:19.914831 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:19.915940 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Aug 29 23:50:19.916372 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 36/73] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:50:20.069442 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_cell0:SELECT=4 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:20.070207 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_cell1:SELECT=4 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:20.070810 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG dbcounter [-] [112630] Writing DB stats nova_api:SELECT=8 {{(pid=112630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:20.122761 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:20.126527 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:20.126901 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:20.127364 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:20.128074 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:20.129428 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:20.129853 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:20.156684 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-8d239947-6be0-4c9f-bc61-69005e81251f admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091948 Aug 29 23:50:20.157262 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 38/74] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:50:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:50:21.017923 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: DEBUG nova.api.openstack.wsgi [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] Calling method '>' {{(pid=112631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:21.019053 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: INFO nova.api.openstack.requestlog [None req-ab396a63-3407-47a4-880f-93a07e490129 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 29 23:50:21.021547 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: [pid: 112631|app: 0|req: 37/75] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 23:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:50:21.230977 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG nova.api.openstack.wsgi [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Calling method '>' {{(pid=112630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:50:21.234819 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.235293 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.235757 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.236565 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.237015 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.237441 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: DEBUG oslo_concurrency.lockutils [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.264212 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: INFO nova.api.openstack.requestlog [None req-f821b95e-6d64-450e-bd5c-aa1ad78f36c6 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096245 Aug 29 23:50:21.265151 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: [pid: 112630|app: 0|req: 39/76] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 23:50:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:19.526288 dv-cinder-855041-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 23:51:19.527712 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: Mon Aug 29 23:51:19 2022 - graceful shutdown triggered... Aug 29 23:51:19.528668 dv-cinder-855041-2-iscsi devstack@n-api.service[112630]: Gracefully killing worker 1 (pid: 112630)... Aug 29 23:51:19.529278 dv-cinder-855041-2-iscsi devstack@n-api.service[112631]: Gracefully killing worker 2 (pid: 112631)... Aug 29 23:51:20.529007 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: worker 1 buried after 1 seconds Aug 29 23:51:20.529007 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: worker 2 buried after 1 seconds Aug 29 23:51:20.529007 dv-cinder-855041-2-iscsi devstack@n-api.service[112629]: goodbye to uWSGI. Aug 29 23:51:20.530891 dv-cinder-855041-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 23:51:20.531674 dv-cinder-855041-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 23:51:20.535129 dv-cinder-855041-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:51:20.545129 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:51:20.547973 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:51:20 2022] *** Aug 29 23:51:20.548219 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:51:20.548363 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:51:20.548480 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: nodename: dv-cinder-855041-2-iscsi Aug 29 23:51:20.548596 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: machine: x86_64 Aug 29 23:51:20.548714 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: clock source: unix Aug 29 23:51:20.549020 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: pcre jit disabled Aug 29 23:51:20.549812 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: detected number of CPU cores: 4 Aug 29 23:51:20.549996 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: current working directory: / Aug 29 23:51:20.550131 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:51:20.550264 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: your processes number limit is 47680 Aug 29 23:51:20.550379 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: your memory page size is 4096 bytes Aug 29 23:51:20.550499 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: detected max file descriptor number: 2048 Aug 29 23:51:20.550630 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: lock engine: pthread robust mutexes Aug 29 23:51:20.550933 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: thunder lock: enabled Aug 29 23:51:20.551246 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:51:20.551449 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:51:20.603332 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: Python main interpreter initialized at 0x562ebdb2d9c0 Aug 29 23:51:20.603332 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: python threads support enabled Aug 29 23:51:20.603332 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: your server socket listen backlog is limited to 100 connections Aug 29 23:51:20.603332 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:51:20.603920 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:51:20.603920 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: *** Operational MODE: preforking *** Aug 29 23:51:20.604131 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:51:20.604131 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: spawned uWSGI master process (pid: 127651) Aug 29 23:51:20.604364 dv-cinder-855041-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:51:20.605602 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: spawned uWSGI worker 1 (pid: 127669, cores: 1) Aug 29 23:51:20.605602 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: spawned uWSGI worker 2 (pid: 127670, cores: 1) Aug 29 23:51:20.605602 dv-cinder-855041-2-iscsi devstack@n-api.service[127651]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:51:21.489553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:51:21.708895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:51:22.993675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:51:22.993675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: from cryptography.utils import int_from_bytes Aug 29 23:51:22.994483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:51:22.994483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: from cryptography.utils import int_from_bytes Aug 29 23:51:23.608355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:51:23.608355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: from cryptography.utils import int_from_bytes Aug 29 23:51:23.609070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:51:23.609070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: from cryptography.utils import int_from_bytes Aug 29 23:51:26.390600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:51:26.391576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:51:26.391918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:51:26.392539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:51:26.393517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:51:26.394689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.394893 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.395324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.395892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.396681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.397154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.397626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.398083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.398698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.399066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.399634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.400289 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855041-2-iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.400743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.401196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.401654 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.402114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.402634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.403179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.403688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.404468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.405589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.406334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.407151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.407937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.408800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.409582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.410401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.411149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.411937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.412744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.413655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855041-2-iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.414207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.414762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.415206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.421018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.422753 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.423269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.424684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.424684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.425166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.426108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.426733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.427498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.427938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.428416 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.428955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.429511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.430010 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.430538 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.431165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.431585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.432008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.432466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.432875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.433293 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.433723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.434228 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.434736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.435219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.435711 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.436387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.436808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.437285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.437824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.438321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.438803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.439309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.440509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.441001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.441688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.442377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.443111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.443638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.444121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.444551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.445022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.445519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.446030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.446512 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.446990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.447468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.447948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.448468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.448964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.449454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.449940 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.450647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.451220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.451637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.452130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.452651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.453156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.453665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.454138 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.454626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.455111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.456148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.456795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.457590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.458088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.458608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.459109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.459644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.460260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.460759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.461277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.461841 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.462354 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.462855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.463376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.463895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.464496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.465044 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.465564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.465971 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.466363 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.466755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.467066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.467534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.467932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.468810 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.469370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.469883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.470400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.471045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:26.471672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.472278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.476209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.477430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.477430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.477430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.478002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.478573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.479083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.479625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.480093 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.481486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.481926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.482346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.482783 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.483220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.483649 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.484067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.484665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.485120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.485549 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.486089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.487187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.487749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.488367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.488879 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.489362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.489872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.490392 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.490958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.491510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.492080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.492665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.493190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.493609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.494028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.494451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.494911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.495333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.495779 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.496377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.496880 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.497306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.497796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.498210 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.498625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.499059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.499465 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.499869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.500422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.500970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.501539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.502065 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.503311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.503897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.504499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.505024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.505579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.506108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.506537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.506976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.507399 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.507809 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.508294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.508724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.509137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.509567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.509978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.510510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.511061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.511618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.512235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.513671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.514008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.514352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.514694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.515167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.515629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.516072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.516547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.519603 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.520149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.520742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.521231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.522055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.522588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.523122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.523677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.524625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.525196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.525719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.526269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.526781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.527286 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.527904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.528511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.529003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.529502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.529996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.530533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.531054 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.531617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.532402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.532923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.533526 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.534048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.534583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.535121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.535619 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.536117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.536705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.537268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.537981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.538523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.538984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.539445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.539905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.540418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.545568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.546761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.546761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.546761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.546761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.547321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.547989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.549822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.549822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.550222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.550652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.551177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.551974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.552568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.553375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.553977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.554446 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.554938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.555416 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.555883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.556466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.557033 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.557571 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.558191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.558729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.559483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.560264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.560931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.561369 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.561865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.562284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.562751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.563244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.563705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.564559 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.565541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.565541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.566113 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.566531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.566953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.567396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.568575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.568575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.570031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.570031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.570544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.570710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.571168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.571617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.572103 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.577345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.578576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.578576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.578576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.578576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.579156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.579399 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.579850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.580929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.581696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.582514 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.583588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.584205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.584752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.585326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.585777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.586236 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.586695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.587273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.587832 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.589184 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.590017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.592264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.592264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.592264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.592264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.592859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.593034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.593517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.594060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.594701 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.595252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.595983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.597147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.597147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.597674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.598216 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.598781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.599334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.600322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.600561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.600973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.601584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.602108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.602705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.603263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.603867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.604527 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.607738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.608591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.609145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.609695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.610236 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.610771 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.611327 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.612744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.613226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.614164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.614432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.614816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.615449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.615987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.616459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.617002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.617566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.618096 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.618646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.619141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.619695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.620271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.620820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.621553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.621976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.622520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.623053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.623602 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.624225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.625052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.625518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.626067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.626635 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.627480 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.628736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.628736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.629281 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.629639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.630190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.630758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.631310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.632381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.632807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.633042 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.633497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.634026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.634591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.635456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.635997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.635997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.636579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.637140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.637762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.638458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.638804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.639224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.639651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.640125 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.641382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.642025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.642550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.643652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.643652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.645057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.645292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.646039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.646398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.647224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.647488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.648025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.648597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.649145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.650107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.650355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.650870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.651447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.652005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.652618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.653709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.653709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.654156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.654571 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.655577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.656305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.656729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.657403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.657915 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.658368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.659025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.659896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.660127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.660688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.661247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.661820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.662368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.662898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.663449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.664232 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.664526 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.665072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.665783 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.668313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.668313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.668313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.668313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.669215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.669772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.670329 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.670879 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.671677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.672271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.672902 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.673262 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.673636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.674538 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.675126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.675657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.676120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.677003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.677811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.678534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.680166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.680166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.680952 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.681317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.681876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.682611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.683397 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.683561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.684063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.686449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.686449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.686449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.687270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.687443 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.688123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.688770 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.689417 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.690004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.692229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.692229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.692755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.692978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.693318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.693992 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.694504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.694979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.695486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.695986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.697162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.697643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.698320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.699189 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.699431 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.699937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.700920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.700920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.701536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.702215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.702474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.702791 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.703308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.703783 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.705130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.707342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.707884 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.708486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.709041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.709633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.710183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.710719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.711220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.712325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.712860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.713371 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.713886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.714405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.714920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.715403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.715920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.716510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.717041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.717624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.718343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.718823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.719282 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.720071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.720569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.721737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.722199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.723011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.724334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.724892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.725312 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.725841 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.726381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.726896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.727463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.728453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.728758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.729295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.729839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.730367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.730782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.731172 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.731659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.732128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.732646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.733190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.733719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.734145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.734537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.734931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.735407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.735905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.736521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.737765 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.737935 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.738253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.738596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.738925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.739253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.739588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.739913 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.740944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.740944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.740944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.741426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.741651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.741986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.742325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.742672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.743005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.743371 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.743650 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.744792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.744792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.744792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.745214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.745349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.745592 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.745911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.746228 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.746542 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.746859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.747176 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.747872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.747872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.748121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.748540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.748885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.749223 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.750102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.750102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.750102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.750505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.750950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.751269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.751608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.751939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.753459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.753631 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.753947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.754285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.754598 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.755050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.755286 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.755600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.755917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.756266 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.760706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.762037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763778 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.763778 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.764000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.764397 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.764553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.765321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.765321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.765615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.765765 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.766053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.766360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.766671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.767131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.767301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.767585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.768590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.770802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.771038 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.771457 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.771672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.772016 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.772396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.772760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.773289 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.773754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.774098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.774415 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.775535 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.775535 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.775535 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.775998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.775998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.776862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.777573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.777573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.778009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.778224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.778435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.778732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.779036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.779291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.780064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.780064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.780738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.780738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.781343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.781343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.781942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.781942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.782330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.782545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.782743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.783072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.783764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.784129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.784403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.785275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.785601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.785950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.786271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.786583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.787089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.787441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.789375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.790218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.790218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.790218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.790609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.790901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.791231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.791544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.791855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.792168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.792506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.792855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.793148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.793795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.793795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.794140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.794352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.794661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.794980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.795379 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.795606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.796085 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.796426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.796644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.796859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.797070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.797368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.797680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.797987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.798294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.798600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.798907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.800400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.800400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.800400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.800400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.801296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.801296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.801296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.801987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.801987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.803019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.803019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.803019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.803646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.803646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.804063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.804337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.804562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.804819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.805135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.805552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.805876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.806237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.806539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.807429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.807429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.807429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.807881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.808054 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.808515 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.808773 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.809041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.809333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.809646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.809965 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.810275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.810633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.810898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.811298 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.811569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.811858 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.812223 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.812550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.812875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.813356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.813702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.814016 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.815947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.816299 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.816621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.816930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:26.817179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:51:26.892249 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Registered counter for database nova_api Aug 29 23:51:26.926167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:26.938760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.038150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.context [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9efe90b-fc44-4963-9806-066476515edb(cell1) {{(pid=127670) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:51:27.045698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.046883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.049400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.051299 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.052097 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.055572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.059084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Registered counter for database nova_cell0 Aug 29 23:51:27.067434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Registered counter for database nova_cell1 Aug 29 23:51:27.077946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:27.086076 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:27.090689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.332548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.344994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Registered counter for database nova_cell0 Aug 29 23:51:27.355356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:51:27.356844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:51:27.356997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:27.357141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:51:27.357277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:51:27.357668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:51:27.358320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.359006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.359595 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.360059 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.360494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.361016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.362201 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.362793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.363647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.364358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.365138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.365613 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855041-2-iscsi {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.366085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.366531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.367069 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.367421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.367600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.368046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.368524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.368950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.369571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.370010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.370495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.370941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.371424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.371841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.372308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.372789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.373151 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.373629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.374132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.374744 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855041-2-iscsi {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.375163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.375574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.375987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.376547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.377218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.378244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.379159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.379321 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.379740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.380243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.380677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.381103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.381526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.381970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.382394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.382811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.383360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.383825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.384345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.384790 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.385257 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.385689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.386112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.386622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.386898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.387325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.387736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.388157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.388635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.389043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.389470 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.389885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.390298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.390705 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.391109 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.391514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.391941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.392404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.392882 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.393828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.394019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.394501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.394767 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.395102 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.395434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.395757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.396070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.396421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.396746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.397056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.397363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.397670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.397990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.398313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.398637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.398872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.399171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.399474 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.399791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.400095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.400426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.400732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.401030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.401333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.401634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.401935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.402234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.402535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.402838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.403139 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.403442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.403741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.404059 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.404515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.404709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.405019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.405323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.405624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.405940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.406242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.406545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.406864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.407165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.407466 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.407778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.408083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.408488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.408995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.409364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.409760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.410080 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.410387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.410691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.410990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.411294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.411595 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.411893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.412214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.412516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.412814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.413128 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.413449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.413755 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.414054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.414354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.414692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:27.415012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.415340 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.415681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.415989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.416356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.416685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.416999 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.417421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.417599 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.417927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.418234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.418540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.418845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.419159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.419473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.419799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.420113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.420452 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.420766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.421072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.421386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.421805 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.422030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.422337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.422676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.423018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.423331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.423651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.423973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.425082 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.425624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.426117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.426472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.426788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.427103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.427418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.427919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.428274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.428589 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.428901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.429211 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.429520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.429829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.430172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.430486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.430809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.431124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.431433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.431748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.432056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.432393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.432706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.433008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.433303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.433609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.433919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.434222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.434542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.434870 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.435183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.435703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.435878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.436161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.436497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.436808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.437110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.437421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.437727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.438035 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.438359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.438664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.438965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.439284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.439587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.440450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.440774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.441089 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.441399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.441711 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.442021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.442350 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.442661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.443002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.443337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.443671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.443977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.444329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.444653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.444970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.445274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.445591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.445944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.446191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.446499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.446789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.447093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.447397 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.447697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.448002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.448332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.448656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.448965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.449265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.449567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.449868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.450213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.450513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.450858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.451196 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.451512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.451835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.452144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.452490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.452797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.453106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.453414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.453721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.454038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.454347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.454663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.454970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.455848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.456312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.456865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.457542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.457866 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.458212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.458552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.458871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.459195 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.459505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.459822 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.460132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.460473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.460849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.461100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.461501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.461758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.462078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.462387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.462715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.463023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.463343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.463646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.463960 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.464332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.464664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.464972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.465283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.465604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.465912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.466340 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.466522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.466816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.467119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.467426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.467740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.468045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.468421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.468671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.468985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.469289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.469594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.469895 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.470206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.470531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.470837 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.471248 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.471804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.472337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.472653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.472985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.473297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.473603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.473908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.474212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.474560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.474869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.475172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.475491 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.475809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.476123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.476537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.476781 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.477299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.477466 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.477732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.478010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.478313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.478624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.478931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.479239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.479560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.479866 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.480266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.480505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.480804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.481111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.481426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.482010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.482341 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.482653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.482968 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.483282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.483619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.483949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.484302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.484646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.484908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.485216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.485520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.485821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.486131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.486435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.487382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.487933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.488458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.488769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.489078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.489387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.489694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.490010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.490314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.490627 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.490932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.491263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.491573 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.491877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.492253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.492496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.492840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.493147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.493487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.493811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.494156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.494459 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.494764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.495086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.495388 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.495692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.496001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.496335 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.496643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.496945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.497255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.497733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.497959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.498158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.498462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.498768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.499071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.499382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.499689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.499988 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.500321 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.500630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.500937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.501239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.501546 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.501849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.502237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.502647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.503182 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.503631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.503943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.504364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.504669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.505002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.505318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.505623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.505924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.506237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.506539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.506842 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.507149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.507471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.507787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.508087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.508453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.508744 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.509050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.509354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.509658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.509957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.510259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.510559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.510856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.511205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.511536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.511842 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.512143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.512472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.512774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.513120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.513422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.513780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.514092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.514482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.514712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.515024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.515332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.515637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.515937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.516287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.516594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.516903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.517204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.517503 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.517907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.518311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.518864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.519273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.519603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.519935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.520264 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.520575 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.520885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.521192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.521497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.521802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.522115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.522424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.522732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.523037 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.523344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.523647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.523955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.524286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.524587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.524915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.525219 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.525518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.525854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.526131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.526440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.526738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.527180 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.527488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.527794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.528093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.528588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.528833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.529069 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.529366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.529672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.530096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.530545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.530712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.531012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.531312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.531613 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.531920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.532268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.532570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.532873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.533176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.534223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.534455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.534953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.535507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.535820 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.536133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.536578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.536889 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.537196 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.537517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.537834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.538154 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.538458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.538850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.539073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.539393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.539713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.540021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.540366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.540742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.540986 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.541308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.541621 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.541937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.542372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.542696 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.543006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.543332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.543655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.543977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.544284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.544597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.544898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.545202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.545524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.545826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.546139 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.546441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.546748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.547048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.547372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.547694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.547993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.548339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.548652 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.549148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.549523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.550056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.550528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.550919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.551134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.551433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.551737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.552083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.552415 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.552736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.553068 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.553395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.553700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.554032 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.554356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.554672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.554987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.555310 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.555611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.555911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.556267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.556558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.556862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.557166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.557473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.557770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.558074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.558373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.558695 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.559023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.559375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.559612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.559915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.560242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.560548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.560891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.561235 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.561515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.561823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.562146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.562462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.562775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.563087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.563401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.563715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.564025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.564366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.565202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.565551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.566085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.566574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.567149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.567480 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.567791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.568104 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.568448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.568763 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.569138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.569379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.569692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.570044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.570431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.570684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.571001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.571489 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.571737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.571946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.572305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.572618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.572930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.573288 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.573663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.573967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.574280 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.574592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.574929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.575249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.575560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.575869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.576243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.576518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.576830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.577140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.577451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.577776 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.578111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.578427 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.578739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.579072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.579387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.579952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.580317 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.580845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.581583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.581798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.582367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.582764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.583057 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.583361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.583666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.583980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.584317 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.584634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.584938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.585245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.585541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.585863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.586175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.586745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.587120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.587433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.587758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.588081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.588469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.588731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.589054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.589362 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.589667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.590103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.590336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.590570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.590915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.591191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.591498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.591797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.592101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.592430 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.592759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.593058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.593361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.593667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.593974 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.594274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.594572 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.594875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.595176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.595483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.595780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.596733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.597852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.597852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.598309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.598722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.599223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.599671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.600084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.600612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.601043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.601455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.601887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.602300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.602745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.603226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.603641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.604379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.604823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.605246 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.605692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.606125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.606539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.606951 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.607363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.607815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.608296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.608713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.609130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.609547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.609956 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.610366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.610860 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.611275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.611925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.612977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.613141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.613547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.613992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.614414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.614847 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.615298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.615720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.616135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.616601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.617019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.617440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.617852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.618275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.618683 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.619100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.619559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.620030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.620498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.621132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.621549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.621970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.622404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.622815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.623266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.623769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.624246 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.624673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.625101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.625533 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.625982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.626413 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.626845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.627808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.628399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.629063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.629428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.629916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.630333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.630746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.631233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.631651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.632063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.632535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.632945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.633393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.633878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.634324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.634775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.635190 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.635504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.635814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.636126 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.636508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.636817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.637127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.637434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.637745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.638158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.638600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.639032 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.639444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.639899 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.640368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.640792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.641310 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.641697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.642065 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.642429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.643176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.643556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.643979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.644500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.645285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.645524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.645943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.646362 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.646797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.647228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.647649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.648081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.648539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.648964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.649382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.649809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.650338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.650754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.651174 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.651685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.652100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.652584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.653015 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.653433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.653846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.654265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.654760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.655226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.656066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.656294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.656648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.657078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.657531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.657953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.658929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.659839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.660240 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.660588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.661030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:27.661384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:51:27.806789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:27.816532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:27.835736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO dbcounter [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Registered counter for database nova_api Aug 29 23:51:27.867462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:27.876836 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writer thread running {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.952891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.context [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9efe90b-fc44-4963-9806-066476515edb(cell1) {{(pid=127669) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:51:27.958587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.959253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.960956 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.961772 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.962223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.964416 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.966545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO dbcounter [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Registered counter for database nova_cell0 Aug 29 23:51:27.971940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO dbcounter [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Registered counter for database nova_cell1 Aug 29 23:51:27.982713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:27.995215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writer thread running {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:27.995952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:28.156748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writer thread running {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:28.168918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO dbcounter [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Registered counter for database nova_cell0 Aug 29 23:51:28.176793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:28.182313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writer thread running {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:28.248121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:28.259354 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-78031bcc-d22a-459f-a91b-5ccf29294d48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:28.269438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x562ebdb2d9c0 pid: 127670 (default app) Aug 29 23:51:28.524301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: WARNING keystonemiddleware.auth_token [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:28.531951 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: WARNING keystonemiddleware.auth_token [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:28.899119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: WARNING keystonemiddleware.auth_token [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:28.905481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: WARNING keystonemiddleware.auth_token [None req-6cf10a3f-296d-489f-8121-c2ebec92876f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:28.911581 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x562ebdb2d9c0 pid: 127669 (default app) Aug 29 23:52:26.653595 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:26.654483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:26.655833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:26.656891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:27.721789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9044a89c-9e2e-461f-a566-d79fdf3b88c5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: .version_select at 0x7fd5a754f0d0>, body: {"keypair": {"name": "tempest-keypair-985689535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXJT3Rt/hkuigEs6IIE+3BUqg4UXfdAlkDPVZ7UHS8+2B9eagSvjxH5YgLZirzmauojmHicRF7B8Y3sCwc+rpn/tYsFGgZk0cU5f9NVnJInRIzyM33CHcuOIzM1U+7zZg=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:27.845040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-9044a89c-9e2e-461f-a566-d79fdf3b88c5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:27.862852 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-9044a89c-9e2e-461f-a566-d79fdf3b88c5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:28.109943 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9044a89c-9e2e-461f-a566-d79fdf3b88c5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.465377 Aug 29 23:52:28.115432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:52:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:29.287768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:29.288849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:29.293736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:29.299409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:30.238912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-541654924", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "networks": [{"uuid": "93e0a306-b92e-472d-869d-9065a5f6f97f"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:30.835188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] validate_networks() for [('93e0a306-b92e-472d-869d-9065a5f6f97f', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:32.995202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-948031498", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:34.198834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] validate_networks() for [('e198d273-347a-4fa0-82d5-22e40c3600ea', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:34.808189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:34.809319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:34.810027 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:34.811152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:34.811693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:34.862269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:34.864464 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:34.865962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:34.869078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:34.872629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:34.873861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:34.971333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Getting quotas for project 651125f8b5f9452a8f854ae229670514. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:34.991429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Getting quotas for user 4c4fddfb77b14b16a65314b3aff68930 and project 651125f8b5f9452a8f854ae229670514. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:35.028375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:35.038053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:35.313476 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-85b17939-595d-47fd-8523-a74f508aab74 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.031592 Aug 29 23:52:35.321443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 1/2] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 6035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:52:36.077228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-378bf0df-4f6d-4e68-9a4d-8459c3902c53 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: .version_select at 0x7fd5a6af7c10>, body: {"keypair": {"name": "tempest-keypair-1826367998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEIakcx1IXrCSB/JHiDKH70BL2lLmDaoJcI5zUcG5aZUCL3Xwm7npttS4wCgqT0pCiUx4q9VGaJpmVp9uWHN4az8QPnNl4526sNz8wSKqAfMGdP6OBNUNAlsBRKrxjdOA=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:36.222292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-378bf0df-4f6d-4e68-9a4d-8459c3902c53 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:36.301280 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-378bf0df-4f6d-4e68-9a4d-8459c3902c53 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for user 33926e50bce94a7e91fb2cd1a3071b73 and project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:36.570458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-378bf0df-4f6d-4e68-9a4d-8459c3902c53 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.252908 Aug 29 23:52:36.571758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 2/3] 10.222.0.90 () {62 vars in 1200 bytes} [Mon Aug 29 23:52:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 23:52:37.017729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:37.018608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:37.019430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:37.020064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:37.020989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bb3e27a0-4a70-4b3b-adae-0a0e07c6a3fb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: .version_select at 0x7fd5a6af7d30>, body: {"keypair": {"name": "tempest-keypair-544672288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1F87uHZGE69XQaZCAEXWvXmJaPciZ4kDCfypl8iky+uM/91m6FDxgfH1pq1N68lRhz64d/5omeM66Q4mWNwxBQVzBIC0Uj7xlWSP4vVEB+NbKceGZHqb3cOfdmCbDJEw=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:37.021853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:37.052723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:37.053732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:37.054387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:37.055572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:37.056360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:37.069926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:37.075601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-bb3e27a0-4a70-4b3b-adae-0a0e07c6a3fb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for project 4b68600b8657473eb43d16098bbcacf6. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:37.089624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-bb3e27a0-4a70-4b3b-adae-0a0e07c6a3fb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for user 9b06987b00c245c0b8a9f3f4bb977bb1 and project 4b68600b8657473eb43d16098bbcacf6. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:37.150324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:37.167952 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for user 57998546e6a64d42ba3ded9f3267e6af and project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:37.211659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:37.221158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:37.283207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bb3e27a0-4a70-4b3b-adae-0a0e07c6a3fb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.687269 Aug 29 23:52:37.292631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 3/4] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:52:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:37.315522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f8fce2ac-d2a4-468e-ba0a-c83467fc8843 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:37.317498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f8fce2ac-d2a4-468e-ba0a-c83467fc8843 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:37.598023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-497eb4dc-6e5c-4473-8791-243629d8b401 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.939749 Aug 29 23:52:37.612213 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 2/5] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:52:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:52:37.666281 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909956654", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b40027-b034-467e-a623-8d465afe9154"}], "security_groups": [{"name": "tempest-securitygroup--2021165668"}], "key_name": "tempest-keypair-985689535", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:37.677782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f8fce2ac-d2a4-468e-ba0a-c83467fc8843 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:37.753840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f8fce2ac-d2a4-468e-ba0a-c83467fc8843 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1214 microversion: 2.1 time: 0.459137 Aug 29 23:52:37.758909 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 4/6] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:37 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1214 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:37.778325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d5e78728-8093-4e8e-8adf-e796879e344e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:37.781944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d5e78728-8093-4e8e-8adf-e796879e344e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:38.143268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d5e78728-8093-4e8e-8adf-e796879e344e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:38.155241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d5e78728-8093-4e8e-8adf-e796879e344e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1221 microversion: 2.1 time: 0.394815 Aug 29 23:52:38.165250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 5/7] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:37 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1221 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:38.504753 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] validate_networks() for [('60b40027-b034-467e-a623-8d465afe9154', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:38.696387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1140598836", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:38.888328 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] validate_networks() for [('e198d273-347a-4fa0-82d5-22e40c3600ea', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:39.967460 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:39.968746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:39.969455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:39.970122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:39.970910 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:39.999621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.001965 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.003192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.007304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.008227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.008890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.089356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:40.096155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:40.116112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:40.133159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:40.419675 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:40.421074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:40.422215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:40.423438 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:40.426867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:40.442815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.443304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.443736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.444566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.447039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.453330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.481551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:40.486899 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for user 57998546e6a64d42ba3ded9f3267e6af and project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:40.515277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:40.519825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:40.557498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ecd4cb0c-27f4-494d-b770-1e07f946dc36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.932561 Aug 29 23:52:40.561238 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 3/8] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:52:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:52:40.575815 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:40.576825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:40.655074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.665695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.667332 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.673155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.681988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.683966 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.726867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c3510e27-67a6-403d-840f-1e6b2093ad6a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.038821 Aug 29 23:52:40.727824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 6/9] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:52:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:52:40.739262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9ad97281-e56c-457e-b508-9ccd9ff36231 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:40.744256 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9ad97281-e56c-457e-b508-9ccd9ff36231 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:40.896925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9ad97281-e56c-457e-b508-9ccd9ff36231 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:40.921179 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9ad97281-e56c-457e-b508-9ccd9ff36231 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1241 microversion: 2.1 time: 0.186681 Aug 29 23:52:40.921863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 7/10] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:40 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:40.958994 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c61e743c-784d-4f62-97d1-91730039da10 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:40.966174 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c61e743c-784d-4f62-97d1-91730039da10 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:41.144472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c61e743c-784d-4f62-97d1-91730039da10 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:41.154212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c61e743c-784d-4f62-97d1-91730039da10 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1222 microversion: 2.1 time: 0.207702 Aug 29 23:52:41.154815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 8/11] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:40 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1222 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:41.346601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:41.374724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-883f5b46-f829-4259-adb3-cb736480006f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1210 microversion: 2.1 time: 0.808444 Aug 29 23:52:41.380927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 4/12] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:40 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1210 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:41.963351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-77814e35-f7cd-4bd2-84f7-d628481a783a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:41.964725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-77814e35-f7cd-4bd2-84f7-d628481a783a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:42.105437 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-77814e35-f7cd-4bd2-84f7-d628481a783a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:42.126581 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-77814e35-f7cd-4bd2-84f7-d628481a783a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1241 microversion: 2.1 time: 0.169134 Aug 29 23:52:42.139180 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 9/13] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:41 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1241 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:42.176316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-368c8aff-9586-4676-ab6b-71a6dfecabb9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:42.177010 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-368c8aff-9586-4676-ab6b-71a6dfecabb9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:42.408525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:42.409174 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:42.430061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:42.430783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:42.431971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:42.441374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:42.442691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:42.455052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:42.611145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-368c8aff-9586-4676-ab6b-71a6dfecabb9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:42.646785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-368c8aff-9586-4676-ab6b-71a6dfecabb9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1222 microversion: 2.1 time: 0.470582 Aug 29 23:52:42.662586 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 5/14] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:42 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1222 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:42.947553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:42.974455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3242d4af-a196-4388-b85d-709043dc6ace tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1266 microversion: 2.1 time: 0.572084 Aug 29 23:52:42.989220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 10/15] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:42 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1266 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:43.162908 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aee4a4a5-30fb-4f83-822f-0ba61dd1a3fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:43.163552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aee4a4a5-30fb-4f83-822f-0ba61dd1a3fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:43.354492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aee4a4a5-30fb-4f83-822f-0ba61dd1a3fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:43.374795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aee4a4a5-30fb-4f83-822f-0ba61dd1a3fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1241 microversion: 2.1 time: 0.208676 Aug 29 23:52:43.374795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 6/16] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:43 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:43.670226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:43.671192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:43.687085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:43.687761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:43.688622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:43.691538 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:43.692416 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:43.693132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-79875075", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a46036d-55d3-472c-985d-7d32e6afcac9"}], "security_groups": [{"name": "tempest-securitygroup--460487139"}], "key_name": "tempest-keypair-1826367998", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:43.694267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:43.852349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:43.867884 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e29f7122-5006-4f3a-8420-1a6c5b4ef76e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1226 microversion: 2.1 time: 0.200753 Aug 29 23:52:43.870739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 11/17] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:43 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1226 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:43.994195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] validate_networks() for [('7a46036d-55d3-472c-985d-7d32e6afcac9', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:44.009857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:44.011411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:44.024939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.027105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.030731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.031226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.033375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.034636 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.185406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:44.201382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9a194661-1727-4ef2-9558-e4d26d419b7a tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1266 microversion: 2.1 time: 0.195509 Aug 29 23:52:44.215370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 12/18] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:44 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:44.634286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:44.634286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:44.634286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.634286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.636332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.636332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.636332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.636332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.636687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:44.636687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-31ab098d-89e2-4410-b4d1-257c1a8a3e2d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1245 microversion: 2.1 time: 0.120568 Aug 29 23:52:44.636687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 13/19] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:44 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:44.654418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:44.654845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:44.655553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:44.655982 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:44.656600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:44.667414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.668250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.668918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.670960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.671433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.671853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.694203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:44.699597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for user 33926e50bce94a7e91fb2cd1a3071b73 and project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:44.721803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:44.735794 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:44.892823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:44.894671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:44.905082 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.912679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.914700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.915494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.915985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.917808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.973149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cef38258-df08-4cd5-bcbd-ac54311b032d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.292137 Aug 29 23:52:44.974917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 7/20] 10.222.0.90 () {62 vars in 1188 bytes} [Mon Aug 29 23:52:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 23:52:44.993361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:44.994713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:45.139930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.164088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-55d3f65b-afb4-4a20-a268-db751ad17cf9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1218 microversion: 2.1 time: 0.274975 Aug 29 23:52:45.164088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 14/21] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:44 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:45.224649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:45.225342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:45.250962 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.263827 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.269862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.276296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.278766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.278766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.278766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.278766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.283195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.285908 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-24341053-a8e0-435d-94bf-1c90204932b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1280 microversion: 2.20 time: 0.303163 Aug 29 23:52:45.291647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 8/22] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:44 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1280 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:45.438028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1556481925", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9cdff2-05de-4391-b19a-4c2f9845a0aa"}], "security_groups": [{"name": "tempest-securitygroup--678421628"}], "key_name": "tempest-keypair-544672288", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:45.533400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.542484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f8f20def-f173-4573-8ff1-433b8510236d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1274 microversion: 2.1 time: 0.323523 Aug 29 23:52:45.543853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 15/23] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:45 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1274 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:45.627083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:45.627701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:45.644526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.645599 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.646050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.646885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.647372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.658602 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.695742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] validate_networks() for [('4c9cdff2-05de-4391-b19a-4c2f9845a0aa', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:52:45.878762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.897830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b932dcf2-e7c7-4911-84f9-7421b28ce95f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1293 microversion: 2.1 time: 0.274700 Aug 29 23:52:45.904055 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 16/24] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:45 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1293 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:46.186425 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:46.187089 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:46.197208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:46.200595 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:46.210529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:46.217522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:46.218582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:46.218877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:46.742747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:46.765395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6c2764b0-5dbd-49e5-ba72-1178cb94e140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1274 microversion: 2.1 time: 0.582780 Aug 29 23:52:46.768738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 17/25] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:46 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1274 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:46.794358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:46.796952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:47.544048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:52:47.544569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:52:47.545204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:52:47.546017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:52:47.546555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:52:47.554995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:47.569986 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:47.572659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:47.575944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:47.580673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:47.580881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:47.582159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-037cb169-3c6e-43de-a998-54ce05f85445 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1280 microversion: 2.20 time: 0.807641 Aug 29 23:52:47.582559 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:47.583164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:47.585091 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:47.604748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 18/26] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:46 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1280 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:47.619557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:47.622823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:47.624404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for project 4b68600b8657473eb43d16098bbcacf6. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:52:47.629557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for user 9b06987b00c245c0b8a9f3f4bb977bb1 and project 4b68600b8657473eb43d16098bbcacf6. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:52:47.644390 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:52:47.650154 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:47.651756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:47.651756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:47.652076 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:47.652905 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:47.653678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:47.657090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:52:47.946979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2001f32d-f02e-4824-9140-182f75ea988f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.518818 Aug 29 23:52:47.949632 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:47.953216 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 9/27] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:52:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:52:47.961774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2b9c019c-1bce-4b67-b0af-95dbb0f43447 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1272 microversion: 2.1 time: 0.355603 Aug 29 23:52:47.971493 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 19/28] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:47 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:47.978296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:47.982184 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:47.988865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:47.994743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:47.998135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:48.023444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.030499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.031179 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.038168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.038757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.039342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.040117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.040609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.044312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.045049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.061703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.066643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.387709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:48.401129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d123310c-191e-4eb6-ab3e-52f1f48837db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1280 microversion: 2.1 time: 0.425070 Aug 29 23:52:48.403254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 20/29] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:47 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1280 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:48.412048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7de6191f-9c58-4cae-8033-a401c423844e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:48.418376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7de6191f-9c58-4cae-8033-a401c423844e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:48.499583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:48.512280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ffbac209-e18a-4499-8ab3-6a6e82c8d0e0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1311 microversion: 2.1 time: 0.557141 Aug 29 23:52:48.515563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 10/30] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:47 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:48.597036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7de6191f-9c58-4cae-8033-a401c423844e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:48.619162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:48.619162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:48.640332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7de6191f-9c58-4cae-8033-a401c423844e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1237 microversion: 2.1 time: 0.232360 Aug 29 23:52:48.640958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 21/31] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:48 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1237 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:48.645119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:48.670326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.671030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.671602 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.675129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.675789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.679007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.995656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:48.996554 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:49.006464 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.021868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.022318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.023063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.023552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.023975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.171492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.190188 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.193170 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.194591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-66c1d305-ef2f-48be-bbb3-cb5542907e62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1276 microversion: 2.20 time: 0.586847 Aug 29 23:52:49.196197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 11/32] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:48 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1276 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:49.425610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:49.426303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:49.433177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.434007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.434652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.435580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.436340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.437582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.499787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.509454 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-34d8e7b8-8263-468a-a7c3-4d82688f7127 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.517631 Aug 29 23:52:49.524204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 22/33] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:48 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:49.549574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:49.550197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:49.591873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.595641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.599014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.599828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.601916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.603037 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.603609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.624410 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-53c99c0e-9415-4c3b-a9a5-fae3424a6edc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1280 microversion: 2.1 time: 0.204304 Aug 29 23:52:49.628342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 12/34] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:49 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:49.664972 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4f423e91-9290-4b45-9c3f-c09b845720ba tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:49.665857 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4f423e91-9290-4b45-9c3f-c09b845720ba tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:49.709365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.718096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-db25f8af-46d6-43fa-a26c-3cdf7fe9ee28 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.187226 Aug 29 23:52:49.718845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 23/35] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:49 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:49.753288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4f423e91-9290-4b45-9c3f-c09b845720ba tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:49.767248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4f423e91-9290-4b45-9c3f-c09b845720ba tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1237 microversion: 2.1 time: 0.105521 Aug 29 23:52:49.770059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 13/36] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:49 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:50.220503 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:50.221118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:50.231699 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.232255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.232760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.233487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.239947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.240854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.327535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.344740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.347044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.349981 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3f056106-3ebf-49cc-aabd-e8ffe172d949 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.134902 Aug 29 23:52:50.351047 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 24/37] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:50 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:50.534756 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:50.535376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:50.542225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.543847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.543847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.544961 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.545543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.546165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.657437 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:50.665367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:50.685826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:50.693532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.695236 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.700042 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.701270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.701927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.702373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.750876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.763160 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ac581716-1cd7-436f-80c2-26b68e6ce210 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.231724 Aug 29 23:52:50.765656 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 14/38] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:50 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:50.774335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:50.776036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:50.794493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.794976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.795426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.796212 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.796835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.797483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.903840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.913627 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0492ca41-488b-4921-a183-76c7cfc15776 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.146212 Aug 29 23:52:50.928448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 15/39] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:50 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:50.932851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:50.933628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:50.945525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.945525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.945525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.945525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:50.946244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:50.946244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.953208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.961665 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9a532f39-811b-45a2-bbac-f43f3fc908a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.319584 Aug 29 23:52:50.962687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 25/40] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:50 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:51.011441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:51.019406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6336eda7-60a6-4c2a-9795-7f21d9b379d3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.103381 Aug 29 23:52:51.020011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 16/41] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:50 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:51.377036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:51.378148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:51.388140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.388140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.388140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.388140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.388499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.388499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.474091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:51.483835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:51.485858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:51.486601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cf54e9fe-dc12-4209-a0ac-9b85b482fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.113626 Aug 29 23:52:51.487162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 26/42] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:51 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:51.789883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:51.790497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:51.798934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.800137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.800688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.801597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.802320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.802964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.940103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:51.945564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:51.955504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.956329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.956935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.966895 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.967816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.968860 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.013744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.027954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f86bba94-9566-4b51-8caf-f5df0d4442b7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.242164 Aug 29 23:52:52.029474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 17/43] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:51 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:52.037744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:52.038993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:52.046710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.047511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.050474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.050474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.050762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.053373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.106549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.112021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:52.118567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9e5d24a5-a07d-4503-8ade-95381a34ec7e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.187249 Aug 29 23:52:52.124359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 27/44] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:51 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:52.125113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:52.126823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:52.133689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.134500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.135142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.147449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.151502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.153162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.279741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.295417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ac3f89bc-9b72-4a3d-af13-2dcc0b0984ca tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.170132 Aug 29 23:52:52.296374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 28/45] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:52 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:52.340900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.351090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-85ff738d-9774-4a3c-9dee-4273c4cf4f24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.320291 Aug 29 23:52:52.365545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 18/46] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:52 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:52.511793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:52.512779 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:52.519344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.526552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.527093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.527926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.532506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.533428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.630656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.646994 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.648643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.649874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-dd408bc7-a297-48c7-8628-97d879e80d98 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.142575 Aug 29 23:52:52.650544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 29/47] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:52 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:52:53.053641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.061867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.061867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.061867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.061867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.062422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.062787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.064546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.151269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.152515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.165420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.166362 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.167140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.169043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.169516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.169985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.274036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.283940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8810ad87-f618-48f8-a0e9-fec8adc57955 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.144004 Aug 29 23:52:53.288582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 30/48] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:53.308309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.318740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.319175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86a240c7-76f1-4673-9335-7df5eeda0fca tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.272188 Aug 29 23:52:53.319779 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 19/49] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:53.320524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.327880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.328427 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.328896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.329616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.330221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.330657 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.374612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.382879 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.391730 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.392590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.393029 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.393821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.394500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.395093 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.406935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.418993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c77fe045-31a9-4b5b-9781-ad212097070b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.104506 Aug 29 23:52:53.431146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 31/50] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:53.591362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.606182 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-adf097d5-989f-4fe6-b146-604e2fbc3c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.235448 Aug 29 23:52:53.618767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 20/51] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:53.683006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.683607 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.694178 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.695069 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.700571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.701436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.702271 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.702868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.802661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.811623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.814130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.815593 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-322a247e-05f9-4f45-9cda-3c60bcbc8b7f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.139441 Aug 29 23:52:53.816625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 32/52] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:54.314474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.315034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.321681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.322262 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.322997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.323825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.324422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.324864 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.339890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.340559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.351691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.352215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.359140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.372382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.372382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.372382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.418486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.429376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-77ae4ac9-9a97-4ae2-b966-77f062a55784 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.119172 Aug 29 23:52:54.429916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 21/53] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:54.448288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.449345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.457630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.458996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.459873 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.461091 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.461564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.462148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.587005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.598495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-62e58036-132d-47f7-8aa8-3991de59f51d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.154013 Aug 29 23:52:54.608946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 22/54] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:54.630153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.631006 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.638880 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.639539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.640264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.640844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.641466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.641959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.647813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.655896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-34f44bc5-8f31-4e1e-a73b-c012c419b9fa tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.319828 Aug 29 23:52:54.661980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 33/55] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:54.823386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.826281 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-046bbcd2-0733-44c9-9801-b279a49f4e21 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.201124 Aug 29 23:52:54.827274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 23/56] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:54.846370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.846983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.864977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.865579 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.866234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.867728 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.868795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.869398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.939640 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.947725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.949499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.950633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cb0305ba-e427-43ce-9301-6b8f8d47ca66 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.108305 Aug 29 23:52:54.951196 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 34/57] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:55.450494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:55.451116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:55.458047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.458534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.459277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.459984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.472659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.473188 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.570292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:55.578147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5262568a-cabf-4b92-911b-13c61da40d43 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.131816 Aug 29 23:52:55.579481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 24/58] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:55 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:55.624773 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:55.625370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:55.632540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.633028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.633997 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.634214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.634681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.635093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.684026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:55.685572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:55.694316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.694806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.695230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.696651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.697141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.698186 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.714431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:55.721857 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:55.728855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a1dc8fd7-ee95-4f40-b236-f4b90f33999b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.108052 Aug 29 23:52:55.730192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 35/59] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:55 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:55.850750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:55.852587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:55.865220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.868658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.869324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.870226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:55.871247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:55.872049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:55.977918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.008025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bb80a6c4-fefc-4f45-bf92-f53bb6bfd6fc tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.328922 Aug 29 23:52:56.030046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 25/60] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:55 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:56.046464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:56.047081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:56.075388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.075902 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.081646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.082441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.082927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.083365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.120335 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.135108 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fda2dc4b-e43a-4439-be09-86c202297861 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.288293 Aug 29 23:52:56.149144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 36/61] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:55 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:56.190068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.200122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.202575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.204885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-78210a4e-f3b2-4e0b-a954-2c5034b1590d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.172647 Aug 29 23:52:56.205273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 26/62] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:56 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:56.604542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:56.605407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:56.617823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.618207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.622465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.622465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.622465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.622465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.753606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:56.754405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:56.761062 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.769738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.770276 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.773563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.774369 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.775757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.926622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.938830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d316c7a9-1d77-4675-8e2e-cfc76cbad321 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.338109 Aug 29 23:52:56.943304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 37/63] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:56 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:56.963827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.973028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ccbf40b-922a-48f4-84ec-b01ffab3e3e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.225329 Aug 29 23:52:56.988027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 27/64] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:56 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:57.040480 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:57.041129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:57.049651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.050612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.051270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.053250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.053250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.053250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.158429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:57.160620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:57.167468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.180070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.180070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.180070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.180070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.180459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.307739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.320487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-06a13ce6-f60e-471f-8ccb-90a7067bc2a7 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.286429 Aug 29 23:52:57.334157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 38/65] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:57.339191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:57.339819 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:57.364675 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.365374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.368528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.369813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.370440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.377623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.467073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.493280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-25a5b1e5-c2fb-4011-93d5-e6fd220bdee3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.340446 Aug 29 23:52:57.495075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 28/66] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:57.513106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.522935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.526443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.527790 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-88feaebb-01d4-4f97-997c-3de3e7c7b2eb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.192514 Aug 29 23:52:57.528478 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 39/67] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:57.971780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:57.974264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:57.983010 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=8 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:57.985943 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.986625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.987186 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.988488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.989455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.990107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.022616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.022616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.022616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.022616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.024975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.024975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.024975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.024975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.155495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.166758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-826e62b9-352e-4bd1-934d-043a04507889 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.199578 Aug 29 23:52:58.200754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 29/68] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.200833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.200833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a2505645-e23b-4002-8ca4-df439940b1be tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.198120 Aug 29 23:52:58.200833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 40/69] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.341874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.342490 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.353052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.353855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.356445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.357373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.357993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.358580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.535590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.535590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.549714 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.550339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.550947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.551685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.552145 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.553107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.651829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=34 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:58.666737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.693455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-32202bca-70e9-49d9-8237-e0987b7ed3c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.355605 Aug 29 23:52:58.694315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 30/70] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:58 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.699127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.699688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.715503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.716574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.717451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.718707 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.721197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.721197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.787461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.796435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-eb0f3b4a-66f4-4215-96ee-3275e8c496ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.283898 Aug 29 23:52:58.797452 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 41/71] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:58 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.848551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.865208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.866822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.867997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-37a96d79-01d4-4e95-a84d-42a32a86f4d9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.173014 Aug 29 23:52:58.868661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 31/72] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:58 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:59.214533 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:59.215800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:59.228052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:59.228926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:59.257776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.259767 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.261500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.263308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.264111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.265061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.265556 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.267368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.268314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.268798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.269525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.274914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.369991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:59.378931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-142039c4-d2be-497c-a0d5-e6b267ff83ec tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.168291 Aug 29 23:52:59.380000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 42/73] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:59 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:59.395846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:59.403881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ff5da57-11ae-4e5c-8702-9069e36d0b94 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.179928 Aug 29 23:52:59.404629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 32/74] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:59 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:59.736410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:59.738186 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:59.770722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.772418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.774752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.776660 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.778006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.779096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.828967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:59.830155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:59.832481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=36 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:59.839353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.839847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.840516 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.841246 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.841910 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.842337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.253631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.259698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.264216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-988c71e5-dec9-4b80-b578-9be4d957e7c3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.541265 Aug 29 23:53:00.264953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 43/75] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:59 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:00.277108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0839a7a7-a8ce-41f3-93d5-6484807f2580 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.449467 Aug 29 23:53:00.277108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 33/76] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:59 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:00.284580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:00.285562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:00.302781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.309923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.309923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.309923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.309923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.310310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.403103 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.409143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:00.409998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:00.416623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.417418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.417845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.418726 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.419349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.419935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.425211 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.427797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.428917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-de0ec8b7-0b91-48b3-9386-62b37abd88a1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.153407 Aug 29 23:53:00.436999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 34/77] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:00 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:00.436999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:00.438670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:00.455856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:00.464891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.465392 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.466181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.467076 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:00.471655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:00.472381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:00.539298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.549617 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d20043dd-26f7-44c3-963e-1a5f35ac9dd4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1299 microversion: 2.1 time: 0.144460 Aug 29 23:53:00.551369 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 44/78] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:00 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:00.572690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:00.584029 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f38b77dc-0995-4f84-9236-78def7996380 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.151633 Aug 29 23:53:00.585079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 35/79] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:00 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:00.997443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c9c11e-d575-4b60-be05-fe0a27272eac", "tag": "1994af96-ee92-46f3-8bd5-3d9a397cf396"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:01.021775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.023375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.024285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.066604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Creating event network-changed:1994af96-ee92-46f3-8bd5-3d9a397cf396 for instance 94c9c11e-d575-4b60-be05-fe0a27272eac on hv-cinder-85504 Aug 29 23:53:01.067461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 23:53:01.068302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-814efec3-4807-4592-8aa3-30ac39de5da5 req-b65c7c99-d9e1-4537-ade9-d1a1b96f4a42 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 23:53:01.070191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.071001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.071784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.073116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.074255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.075060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.096063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.compute.rpcapi [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 23:53:01.097559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] Releasing lock "compute-rpcapi-router" {{(pid=127669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 23:53:01.126135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2ab78dc1-9f0b-41f5-9e9c-ed3f7bc4ae35 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245414 Aug 29 23:53:01.129376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 45/80] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:01.300363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.301121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.313366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.314158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.314600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.315323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.315780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.316231 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.345730 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022f6c97-74d7-4317-b679-3fb2dad0a739", "tag": "59f1d716-7a45-4a0d-8eb0-20b9102bfd16"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:01.366431 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.366825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.367450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.388400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Creating event network-changed:59f1d716-7a45-4a0d-8eb0-20b9102bfd16 for instance 022f6c97-74d7-4317-b679-3fb2dad0a739 on hv-cinder-85504 Aug 29 23:53:01.389003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 23:53:01.389394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-72b9fcc9-f8b1-4132-aa1c-cd5dfee067a0 req-b1557168-e497-42cf-a8e3-570829d803c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 23:53:01.390465 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.390929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.391390 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.392117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.392602 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.393028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.402735 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.compute.rpcapi [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 23:53:01.403694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] Releasing lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 23:53:01.427558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7faec414-009a-46c8-914d-1010bfd5d814 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163463 Aug 29 23:53:01.429759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 36/81] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:01.439847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.441212 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.452926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.453792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.454621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.456521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.457339 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.458097 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.497287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.515566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9a43d9b4-179c-4ae1-a3e2-5977519c604d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.221483 Aug 29 23:53:01.516803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 46/82] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:01.524945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.526287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.535313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.535803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.536275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.537063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.537513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.537931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.621924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.631192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.632703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.633856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-65b5883d-cde9-4afb-bbee-979264a73129 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.115857 Aug 29 23:53:01.634462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 47/83] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:01.639237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.639857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.641231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.646315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.647130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.647559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.648521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.648738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.649382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.651092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d72eef3d-2cb5-4b57-9d20-21b405780dd4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.219845 Aug 29 23:53:01.651571 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 37/84] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:01.656518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.657658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.663730 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.664239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.664672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.665668 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.666338 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.667311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.767180 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.790146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f9fbb9dc-89da-41c5-9cac-9b77ea90588e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.128008 Aug 29 23:53:01.790146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 38/85] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:01.840823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.851157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a7ca8879-bc5c-4375-84b6-922779129f52 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.215603 Aug 29 23:53:01.851734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 48/86] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:02.538290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:02.538964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:02.545395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.545914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.546317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.547050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.547580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.548006 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.658036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:02.658858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:02.668520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.669278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.670092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.671228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.671948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.672713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.695960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:02.707989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-68d5711c-a39d-48c6-9679-e21a9b0189b0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.173579 Aug 29 23:53:02.709267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 39/87] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:02 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:02.714955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:02.716279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:02.729743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.729743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.729743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.730615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.731011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.731476 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.756373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:02.765176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:02.768005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:02.769267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-86fa1d3d-8cb4-4fcd-a77c-af7d5251e793 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1332 microversion: 2.20 time: 0.116056 Aug 29 23:53:02.770026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 49/88] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:02 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:02.809090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:02.810141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:02.827791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.831719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.832283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.833573 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.834680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.838033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.014894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:03.028694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8f323243-2a86-49c0-a53f-d95bd0c700a6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1241 microversion: 2.1 time: 0.227370 Aug 29 23:53:03.029729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 50/89] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:02 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1241 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:03.043575 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:03.044856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:03.053226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.054005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.054512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.055280 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.055745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.056156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.181248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:03.194978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f95bd82a-e5e7-474a-a9bf-859abe65b17e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.484777 Aug 29 23:53:03.195959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 40/90] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:02 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:03.717127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369a844-afb7-41b8-93e0-822cc05c3da2", "tag": "301565fd-38df-4687-ab85-0e577c9b30a7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:03.745020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.746243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.747564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.806819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] Creating event network-changed:301565fd-38df-4687-ab85-0e577c9b30a7 for instance 2369a844-afb7-41b8-93e0-822cc05c3da2 on hv-cinder-85504 Aug 29 23:53:03.835159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-18528332-faab-4963-84ae-090b70914b12 req-43a134dd-0585-44c9-9c39-60a1bb4063bf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123632 Aug 29 23:53:03.845815 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 41/91] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:03.869129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:03.878146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:03.922564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.922564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.923025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.924157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.925718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.926766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.029927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.065494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d87219dd-c073-4f64-ab48-7208f15157bd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 1.034034 Aug 29 23:53:04.067954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 51/92] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:03 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:04.090811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:04.091897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:04.101384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.102153 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.102963 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.103943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.105506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.106242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.318915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.329698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.331505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.333160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a2c426fc-6913-4d46-8eeb-1f2bb4cc7574 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1338 microversion: 2.20 time: 0.263754 Aug 29 23:53:04.333743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 52/93] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:04 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:04.357647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:04.359305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:04.383529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.383946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.388907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.390053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.391237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.392307 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.557749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.585396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-805f7b3d-99f6-4859-b816-ced438b6cd91 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1289 microversion: 2.1 time: 0.249480 Aug 29 23:53:04.595672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 53/94] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:04 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1289 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:04.599100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:04.601645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:04.620258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.620941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.621650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.622706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.623905 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.624784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.653614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.676386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:04.695929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-969cbc02-dbaf-42ab-801a-9a7d6c5ea0c5 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.849527 Aug 29 23:53:04.697659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 42/95] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:03 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:04.973079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:04.988700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3c0873c4-cb61-4042-a1a3-ddb3a6e63847 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.397969 Aug 29 23:53:04.990410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 54/96] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:04 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:05.110835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:05.111976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.124228 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.125100 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.126267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.127683 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.128695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.129733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.362935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:05.364824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.370133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.370622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.371334 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.372205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.372669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.373094 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.440733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.448555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c598f514-d2f6-4b50-9eb1-1514fc4085bf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.346494 Aug 29 23:53:05.449136 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 43/97] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:05 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:05.472254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.490635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.497610 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.499684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0b886810-053c-44e2-9084-5d97944c6bdc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1338 microversion: 2.20 time: 0.141445 Aug 29 23:53:05.501794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 55/98] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:05 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:05.608121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:05.608793 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.618645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.619077 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.619515 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.620256 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.620720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.621142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.740406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:05.745417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.757263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.758113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.759227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.760256 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.762238 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.763296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.764322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.783018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c99e146b-848c-448c-b675-51c6fdd76017 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1297 microversion: 2.1 time: 0.177732 Aug 29 23:53:05.785391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 44/99] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:05 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:05.921556 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13772077-dc96-4813-925d-975c5748e4d1", "tag": "6887f59b-e47e-4f9a-a537-7f002f8c2044"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:05.950736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.952920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.957927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.997203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] Creating event network-changed:6887f59b-e47e-4f9a-a537-7f002f8c2044 for instance 13772077-dc96-4813-925d-975c5748e4d1 on hv-cinder-85504 Aug 29 23:53:06.036842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-322fdd4f-1103-4652-bcc3-4ff1635ea23d req-4d2ac3dc-04f0-42cb-9f91-2e475ef4e626 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100908 Aug 29 23:53:06.038059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 45/100] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:06.083226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:06.088658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:06.119488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.119488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.119488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.119488 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.120487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.120487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.485684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:06.501356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-32e513ed-ea93-4162-8eca-332d8516f0fb tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.767681 Aug 29 23:53:06.516731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 56/101] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:05 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:06.516731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:06.516731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:06.517112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:06.517289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.517681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.518448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.519585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.520155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.520712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.547844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b8482358-1981-4a26-b31a-872548f62b9c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.485871 Aug 29 23:53:06.547844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 46/102] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:06 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:06.566564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:06.567797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:06.579819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.580707 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.581528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.583408 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.584550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.585561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.327988 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.351909 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8f59de2f-4e52-4117-a8e3-f9c9bd6c9a74 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.847792 Aug 29 23:53:07.352545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 57/103] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:06 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:07.379811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:07.389955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:07.403745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.404552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.405856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.407624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.408439 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.409112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.425812 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.441525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.445570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.447746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2469e0d3-9a4a-4807-92c4-3027b58bf9b6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.900332 Aug 29 23:53:07.449099 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 47/104] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:06 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:07.524226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:07.525323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.526697 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:07.538624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.539396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.539987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.541047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.541691 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.542262 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.545997 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bf0aad59-e177-43e9-ab7a-aef1599c0ad7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1295 microversion: 2.1 time: 0.192376 Aug 29 23:53:07.546673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 58/105] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:07 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:07.568396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:07.569066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:07.581850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.582399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.582863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.585092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:07.587035 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:07.588086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.934964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.961227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3d6f16be-4dd9-4d63-8578-2473693a48d2 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.439574 Aug 29 23:53:07.987967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 48/106] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:07 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:08.006142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.022055 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5c7c0fda-8fa6-49e6-8e4e-100cedd6bcb2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.458060 Aug 29 23:53:08.023009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 59/107] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:07 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:08.378725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.381347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:08.392868 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.393520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.394000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.397446 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.397939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.398613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.404940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:08.428633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.429485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.430112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.456448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] Creating event network-changed:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:53:08.470596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-fafda06b-6211-4fc8-967d-17d6ae74ccde req-5d52c5cc-21e4-4305-a80e-83fd83cfb652 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069776 Aug 29 23:53:08.471217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 60/108] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:08.476697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.477405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:08.499662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.502524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.503798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.505417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.506598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.507613 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.664591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.677660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cb0509e0-3ea6-4d21-97a9-ec6696265563 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.305598 Aug 29 23:53:08.678710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 49/109] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:08.687993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.689703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:08.700830 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.701706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.702654 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.704160 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.705330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.706356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.738597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.755132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.761072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.765218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7a944e62-79ac-4d09-8ecf-7a50986200d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.292813 Aug 29 23:53:08.770886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 61/110] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:08.918789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.927764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f244f017-8f32-4127-81c9-408baba4868b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.247475 Aug 29 23:53:08.928440 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 50/111] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:08.998153 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.998885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.006039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.006528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.006955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.007646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.008093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.012548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.013124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:09.044135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:09.044885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.053491 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.053964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.054557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.066399 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.067498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.072838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.357203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:09.373105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6390dea8-5f5f-4c32-9a9c-fea51c921681 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.378639 Aug 29 23:53:09.388487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 62/112] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:09.492874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:09.511644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f32f1d1c-a537-4f8b-ae87-5f493188efec tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.468301 Aug 29 23:53:09.512814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 51/113] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:09 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:09.590670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369a844-afb7-41b8-93e0-822cc05c3da2", "name": "network-vif-plugged", "status": "completed", "tag": "301565fd-38df-4687-ab85-0e577c9b30a7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:09.610965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.615558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.616279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.639983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] Creating event network-vif-plugged:301565fd-38df-4687-ab85-0e577c9b30a7 for instance 2369a844-afb7-41b8-93e0-822cc05c3da2 on hv-cinder-85504 Aug 29 23:53:09.654232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-0ca0d306-a17c-48d0-898c-9a17bb025668 req-bbb78964-9f47-4229-b55b-bfae7968ffeb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248008 Aug 29 23:53:09.657294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 63/114] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:09.701430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:09.702252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.716543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.719325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.726070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.727308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.727953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.728599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.806406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:09.808441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.827050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.827793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.829021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.830012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.830668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.831247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.251157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.259761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f051958d-b583-42d3-be37-f22c2930acc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.563659 Aug 29 23:53:10.260981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 52/115] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:09 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:10.265241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.265482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:10.267133 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:10.273393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.273871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.274481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.286365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.286365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a40dbcd4-a127-40de-b8cb-09950bc3644b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.475553 Aug 29 23:53:10.286365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 64/116] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:09 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:10.286929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.286929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.286929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.286929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.394654 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:10.395327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:10.407720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.408783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.409356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.410867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.412044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.412768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.502312 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.538418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-69ce0ce6-20bc-4abb-8c8f-5be43e73d9ef tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.276088 Aug 29 23:53:10.556545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 53/117] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:10 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:10.562444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:10.565255 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:10.579368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.580111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.589441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.590698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.591551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.593761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.777347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.789177 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bd104019-8c0e-447a-ae0d-1c13482a2cb0 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.398508 Aug 29 23:53:10.790401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 65/118] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:10 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:10.878677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3de91e-440c-4c11-97f0-8cc634192f45", "tag": "5a748e41-64a4-4228-b0c8-40ef6e76caf4"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:10.913782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.917545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.920087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.931840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:10.967654 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] Creating event network-changed:5a748e41-64a4-4228-b0c8-40ef6e76caf4 for instance 6d3de91e-440c-4c11-97f0-8cc634192f45 on hv-cinder-85504 Aug 29 23:53:10.976283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-7758cbd3-98b1-4801-ba94-5c91e00968b0 req-ad9b778e-8bca-4412-af28-9f61dfc42cab service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106316 Aug 29 23:53:10.979985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 66/119] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:10.982303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-594bd73d-77a7-4d3d-baa6-c3d111de136b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.414086 Aug 29 23:53:10.983888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 54/120] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:10 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:11.296970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:11.296970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:11.296970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:11.309787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:11.310398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:11.324501 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.326916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.327651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.330819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.333079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.334444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.335210 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.335906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.336642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.340571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.341202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.342516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.412894 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:11.833048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.844525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.846615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.848113 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-56660a8d-86a1-45cd-918a-1114d1e538d1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.542408 Aug 29 23:53:11.864744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 55/121] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:11 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:11.871487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:11.871938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:11.903842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.905000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.905385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.906123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.907609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.908150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.965566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.979655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-20b30b0d-93fc-40c3-ab27-9cebe2420511 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.696484 Aug 29 23:53:11.981213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 67/122] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:11 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:11.987717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c9c11e-d575-4b60-be05-fe0a27272eac", "name": "network-vif-plugged", "status": "completed", "tag": "1994af96-ee92-46f3-8bd5-3d9a397cf396"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:12.001253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.001965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.003176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.021672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] Creating event network-vif-plugged:1994af96-ee92-46f3-8bd5-3d9a397cf396 for instance 94c9c11e-d575-4b60-be05-fe0a27272eac on hv-cinder-85504 Aug 29 23:53:12.028672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-6b5f0bd9-1f24-43b7-a16f-1ac5734c9084 req-613d270a-5114-4f09-bc18-6faa5ace3c0d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046019 Aug 29 23:53:12.029458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 68/123] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:12.036615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:12.037809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:12.042075 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:12.048795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.049493 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.050088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.051053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.051686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.052456 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.184066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:12.211290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-17741828-11b4-442f-8cc1-88ffd6e8ac1c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.344433 Aug 29 23:53:12.212302 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 56/124] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:11 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:12.227529 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:12.241484 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:12.257324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.261845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.261845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.261845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.261845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.262452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.451332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:12.465446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ba98fcc8-a54e-4f45-a233-3487bcbd8605 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.434396 Aug 29 23:53:12.466708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 69/125] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:12.667997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:12.677017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c617032d-642b-4057-83ff-e7585e4535f9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.462985 Aug 29 23:53:12.691652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 57/126] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:12.881113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:12.882967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:12.897664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.899213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.901778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.901778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.901778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.902372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.004690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:13.005493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:13.013265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.013754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.014181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.014888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.016022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.017564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.443122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.464016 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b1ca5517-87dc-40d6-9377-29567cd09361 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.462190 Aug 29 23:53:13.464754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 58/127] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:13.479939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:13.481666 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:13.493911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.500834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.502348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.503361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.503826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.505464 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.505822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.506758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f790ca10-60a5-409d-b939-18ce0eb8c23b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.639204 Aug 29 23:53:13.507209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.507737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 70/128] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:13.508749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.524931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:13.525542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:13.533522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.534008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.534938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.535752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.536330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.536717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.803536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.819799 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b8792454-2b1f-47a2-83db-061b8dcb0c11 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.349780 Aug 29 23:53:13.820272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 59/129] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:13 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:13.820605 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.828321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:13.830438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:13.830982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2f876c98-06ca-47c3-b3e6-537f2916046d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1314 microversion: 2.1 time: 0.321809 Aug 29 23:53:13.848662 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:13.857366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 71/130] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:13 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:13.868005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.869408 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.870494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.874974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.877931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.889004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.913629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:14.072430 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022f6c97-74d7-4317-b679-3fb2dad0a739", "name": "network-vif-plugged", "status": "completed", "tag": "59f1d716-7a45-4a0d-8eb0-20b9102bfd16"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:14.089564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.090324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.091017 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.104025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] Creating event network-vif-plugged:59f1d716-7a45-4a0d-8eb0-20b9102bfd16 for instance 022f6c97-74d7-4317-b679-3fb2dad0a739 on hv-cinder-85504 Aug 29 23:53:14.110596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-83197603-2b32-4e43-aa5e-c856496e677b req-4d386936-e6ab-4d4d-8e0c-c2e41a610c93 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042765 Aug 29 23:53:14.111910 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 72/131] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:14.117270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.131314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a1a47216-3692-4337-833a-8eeb66846607 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.309753 Aug 29 23:53:14.131912 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 60/132] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:13 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:14.503128 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.514736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.547219 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.550190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.551595 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.559358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.559874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.560862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.561528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.563108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.563299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.564539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.567695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.570630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.571401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.572241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.943054 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.958805 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.966000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.967555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.968775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ae00474-b108-4f53-8c5d-599be3eb8b94 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.425688 Aug 29 23:53:14.969552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 61/133] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:14.976093 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.978194 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-00527c39-203b-42d7-bb0b-e45568f90556 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.480298 Aug 29 23:53:14.979363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 73/134] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:14.981237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.989709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.990205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.990641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.991352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.991806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.994667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.996378 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.998115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:15.018974 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.020714 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.021865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.023864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.025518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.027857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.354539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:15.369567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-64facfe8-58d3-4bbf-af3a-f6ba77fd8627 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.397771 Aug 29 23:53:15.370186 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 62/135] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:15.380250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:15.380887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:15.392887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.398600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:15.399313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.400261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.403354 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.403989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.404836 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.412114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-04dd3b90-9161-4b8c-9f56-6a41e6c196e3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1501 microversion: 2.1 time: 0.428285 Aug 29 23:53:15.416857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 74/136] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1501 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:15.774182 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:15.786260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2de3bccb-afd1-428f-af3b-2ea0b54060c6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.414573 Aug 29 23:53:15.787238 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 63/137] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:15 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:16.055358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:16.060054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:16.062922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:16.064015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:16.078013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.080782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.081932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.084384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.093391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.095255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.104594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.105607 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.106370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.119673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.119673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.119673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.417928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.419528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.436443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.436443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.436443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0d27cba4-9e83-44e7-99ff-d90f962402cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.389408 Aug 29 23:53:16.449104 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 75/138] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:16 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:16.450520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-499ef32b-2d75-4adf-9ea3-bedbb2b08a85 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.400715 Aug 29 23:53:16.454510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 64/139] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:16 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:16.468058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13772077-dc96-4813-925d-975c5748e4d1", "name": "network-vif-plugged", "status": "completed", "tag": "6887f59b-e47e-4f9a-a537-7f002f8c2044"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:16.468548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:16.468548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:16.485821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.487247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.487948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.498742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.499815 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.500851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.501928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.502298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] Creating event network-vif-plugged:6887f59b-e47e-4f9a-a537-7f002f8c2044 for instance 13772077-dc96-4813-925d-975c5748e4d1 on hv-cinder-85504 Aug 29 23:53:16.503091 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.504447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.509335 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-d8d6a941-059f-4908-97f6-93d0b466fda4 req-70a7903f-4f29-475c-a08f-89752f9053ca service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058594 Aug 29 23:53:16.510847 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 76/140] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:16.669597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.678835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-89492639-38b7-4b96-b407-45e75c1d4137 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.222501 Aug 29 23:53:16.679507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 65/141] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:16 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:16.818276 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:16.819933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:16.855174 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.863165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.869302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.870684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.872776 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.873583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.148938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:17.166302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a8dbf49d-66cd-43b3-a3e8-e330ba851ae3 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.358061 Aug 29 23:53:17.167756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 77/142] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:16 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:17.481033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:17.481643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:17.483930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:17.485272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:17.488901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.489375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.489810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.490511 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.490985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.491580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.496224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.501737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.501737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.501737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.501737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.502058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.736876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:17.744731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:17.745938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5739a602-7414-41ec-b24b-16cdcc7fbdac tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.269686 Aug 29 23:53:17.746569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 66/143] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:17.751995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:17.752637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:17.759041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.759673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.759948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.760945 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.761545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.762101 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.771234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:17.774578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:17.776674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5991f178-6f39-43d8-a291-b36ec5cf532e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.299631 Aug 29 23:53:17.777373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 78/144] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:17.965391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "188952cb-b571-40a7-9532-7ae3760095b3"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:17.970642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:17.993388 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.994545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.996412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.001957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.003268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.005762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.056365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:18.081007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b107b31c-3f33-49fb-8c48-58c1aaa254cf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.329058 Aug 29 23:53:18.086981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 67/145] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:18.190509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:18.191701 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:18.199940 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.200954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.201622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.202639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.203226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.204624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.474936 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:18.495182 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7660d165-3804-4794-988d-2d81beabb5ed tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1322 microversion: 2.1 time: 0.310160 Aug 29 23:53:18.508557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 68/146] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:18 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:18.532111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "name": "network-vif-plugged", "status": "completed", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:18.550081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.550081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.550081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.572970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] Creating event network-vif-plugged:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:53:18.580847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ffa8348a-ea32-48fd-b959-c02336f2cbe8 req-58154578-5430-4241-beff-187f42a9b4b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054110 Aug 29 23:53:18.582036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 69/147] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:18.806605 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:18.807888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:18.830871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.831780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.832639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.834668 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.835577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.836691 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.112483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.122128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-18520133-2dc4-490f-877d-440867386946 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1367 microversion: 2.1 time: 0.327596 Aug 29 23:53:19.123234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 70/148] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:18 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:19.141111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.142251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.159082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.160367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.161528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.163045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.164117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.165247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.418184 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.434264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.435751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.438491 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c7276d25-0482-4fb0-81e5-c7123f1e1e35 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.311745 Aug 29 23:53:19.439472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 71/149] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:19.447145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.448135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.457509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.459064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.463099 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.463309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f5099489-e1cd-41f8-a09b-ab7badce5034 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "POST /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.504665 Aug 29 23:53:19.463981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.463981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.464303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 79/150] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:53:17 2022] POST /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2/os-volume_attachments => generated 194 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:19.465075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.546324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.553101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.589539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.591484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.592616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.595616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.598063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.599692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.812960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.821696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ee10d0ff-6aa8-48ba-961e-dbe314ee660c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.380461 Aug 29 23:53:19.822923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 72/151] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:19.891062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.895135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:19.900120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0e23b842-d52b-4124-8b0c-46bff6d4eba9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1516 microversion: 2.1 time: 0.368075 Aug 29 23:53:19.900746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 80/152] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:19.926750 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:19.929660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.939045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.939579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.940083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.941002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.941739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.942378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.028769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'flavor' on Instance uuid 022f6c97-74d7-4317-b679-3fb2dad0a739 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:53:20.160381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.161232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.176774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.176774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.176774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.176774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.177564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.177564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.439939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a3ddd18c-b7dc-4554-a5d2-88ead9d32f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739/action" status: 200 len: 32 microversion: 2.1 time: 0.518247 Aug 29 23:53:20.440744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 73/153] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:53:19 2022] POST /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739/action => generated 32 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:53:20.452423 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.457923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.459504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.469091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3372b086-8257-43b8-bcce-3288f33a52e9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1557 microversion: 2.1 time: 0.315533 Aug 29 23:53:20.470082 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 81/154] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1557 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:20.479734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.480789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.492478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.492734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.493586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.493924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.494432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.495100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.495366 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.495979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.496469 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.497306 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.498376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.500366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.759620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.773822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e8da2b4-5317-4e4a-838d-5b71e7bd2bf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.324568 Aug 29 23:53:20.774747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 74/155] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:20.779890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.787356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.813040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.813838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.816533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.816533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.816533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.816533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.852620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:20.942494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.955946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.957650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.961120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-20746b09-46ec-466d-a3a8-2545ec86db19 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1405 microversion: 2.20 time: 0.489531 Aug 29 23:53:20.965734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 82/156] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:20.973457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.976914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.993942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.004590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-50b00883-8a4f-4ea5-9ccb-3852286e500e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222540 Aug 29 23:53:21.004590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 75/157] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:21.004869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.004869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.004869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.004869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.005376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.314722 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3de91e-440c-4c11-97f0-8cc634192f45", "name": "network-vif-plugged", "status": "completed", "tag": "5a748e41-64a4-4228-b0c8-40ef6e76caf4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:21.328993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.329700 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.330402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.362705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] Creating event network-vif-plugged:5a748e41-64a4-4228-b0c8-40ef6e76caf4 for instance 6d3de91e-440c-4c11-97f0-8cc634192f45 on hv-cinder-85504 Aug 29 23:53:21.368395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-675bfd50-23ea-44d6-9807-11df33dffa46 req-3494efaa-dee0-418d-9662-d190d9ef4ccc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059584 Aug 29 23:53:21.378703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 76/158] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:21.391001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:21.399714 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-08e59afb-c17c-43ce-9168-27a4570b0982 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.432480 Aug 29 23:53:21.400619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 83/159] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:21.817763 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.819543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:21.836741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.837789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.839379 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.840907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.842107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.843167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.997115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.998469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:22.012942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.014920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.017919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.020877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.022049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.023166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.878829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.887905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ac7a8bdd-0024-4950-80c7-4637f71f15f5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 1.076464 Aug 29 23:53:22.889420 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 77/160] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:22.897209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.909376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:22.909526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.909639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.909639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.909639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.909639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.909976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.910059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.910059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.910222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.910222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8c0348c8-6242-4720-94e2-dd42d017b3b3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1597 microversion: 2.20 time: 0.918808 Aug 29 23:53:22.910580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 84/161] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1597 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:22.933706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.934507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:22.942483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.943061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.943613 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.944387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.945160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.945585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.300232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-12d43d98-5bde-4120-956f-fa45a6070543 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.370318 Aug 29 23:53:23.301280 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 85/162] 10.222.0.90 () {60 vars in 1316 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:53:23.457072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.472047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dea0dc94-b96d-45cb-8243-6f96c520265f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.579049 Aug 29 23:53:23.474406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 78/163] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:23.918443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.923971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:23.947365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.948822 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.950699 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.952516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.954648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.955719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.967458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13772077-dc96-4813-925d-975c5748e4d1", "tag": "6887f59b-e47e-4f9a-a537-7f002f8c2044"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:23.990253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.992059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.992547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.021191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] Creating event network-changed:6887f59b-e47e-4f9a-a537-7f002f8c2044 for instance 13772077-dc96-4813-925d-975c5748e4d1 on hv-cinder-85504 Aug 29 23:53:24.033834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-b3a92813-a88f-4f82-b053-a62bb20ec8cc req-e6bd76a9-ea4e-4597-9b07-2a1ef64fe8a7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067436 Aug 29 23:53:24.034768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 79/164] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:24.285805 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:24.295158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0913ff80-5e62-43a3-bb41-c651ff148526 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.385274 Aug 29 23:53:24.305271 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 86/165] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:24.501082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:24.513987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:24.543637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.545311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.550365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.551147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.551630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.552066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.852785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:24.863752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f325ce58-fab7-4639-8be5-792f26466494 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.369339 Aug 29 23:53:24.865035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 80/166] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:24 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:25.324552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:25.326936 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:25.354244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.357515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.358750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.363033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.363948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.364648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.607957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.623058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8aa85c72-c9b7-4ae2-8a9f-4584d2762c1e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.305852 Aug 29 23:53:25.625178 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 87/167] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:25 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:25.878107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:25.892897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.893934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.894946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.912518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:25.913536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] Creating event network-changed:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:53:25.914639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:25.918824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-66bc4314-8610-4c39-83ec-bee5e67765d9 req-884ace1f-dfb5-48ab-9493-5182aec25b1b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047258 Aug 29 23:53:25.923525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 81/168] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:25.932481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.933253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.933953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.936351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.938460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.939140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.138929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.166943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5813cb66-96f1-432a-8647-8c4badceb826 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.260151 Aug 29 23:53:26.172562 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 88/169] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:25 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:26.656537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:26.658738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:26.668313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.669257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.670164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.671090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.672128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.673064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.988518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:27.013766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2bec4602-2ace-48a1-b30e-62932efafc2d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.366951 Aug 29 23:53:27.017462 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 82/170] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:26 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:27.194084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:27.194758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:27.201864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:27.202351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:27.203085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:27.205645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:27.205645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:27.205645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:27.403161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:27.419381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ab7e0d0a-cbe9-43c5-8db4-08223e991180 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1362 microversion: 2.1 time: 0.228283 Aug 29 23:53:27.420619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 89/171] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:27 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:28.041251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.042221 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:28.050500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.051295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.051879 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.053079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.053643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.054168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.249922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.264552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-05fdfa65-9d88-4cbb-bedb-28f93d9ea7bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.229006 Aug 29 23:53:28.266217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 83/172] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:28.447549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.448863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:28.462164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.463062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.463857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.465217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.466052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.466803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.661757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.670843 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-aa6018b0-2348-469a-ac29-429c95478b2d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1548 microversion: 2.1 time: 0.231505 Aug 29 23:53:28.672033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 90/173] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:28.694699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.695499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:28.706372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.707178 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.707932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.709491 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.710427 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.710996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.850384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b50951af-3c8f-4049-aaf0-2cd8dad066a8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160851 Aug 29 23:53:28.851005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 84/174] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:29.292003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:29.293325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:29.306411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.307273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.309382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.320639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.320639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.320639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.817077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:29.833268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2ca3ff20-0dfe-4952-9595-70e3bba3a003 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.548190 Aug 29 23:53:29.843039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 91/175] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:29 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:30.726640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3de91e-440c-4c11-97f0-8cc634192f45", "tag": "5a748e41-64a4-4228-b0c8-40ef6e76caf4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:30.754793 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.755830 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.756948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.784287 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] Creating event network-changed:5a748e41-64a4-4228-b0c8-40ef6e76caf4 for instance 6d3de91e-440c-4c11-97f0-8cc634192f45 on hv-cinder-85504 Aug 29 23:53:30.796750 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-e9fd1b43-2f38-4fe7-b682-12f3fca9036d req-b4e25394-466a-462c-9b4c-2f1c390279e3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078401 Aug 29 23:53:30.800755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 85/176] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:30.870526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:30.874468 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:30.881525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.882188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.882861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.883557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.884049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.884481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.348458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.385641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3d2d320e-63b6-45d5-b2fd-c69d12f69d3c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.527890 Aug 29 23:53:31.390374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 92/177] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:30 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:32.437600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:32.440800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:32.453958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.455157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.456209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.457859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.459434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.460552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.868023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:32.906069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-51f110c9-257b-45ec-836a-2aeec9f868ea tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.481273 Aug 29 23:53:32.907291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 86/178] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:32 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:33.931716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:33.932745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:33.946324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.947151 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.947841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.948855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.949641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.950582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.227735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:34.240349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4ef32279-94c8-482a-9e06-21782cb73685 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.315321 Aug 29 23:53:34.241123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 93/179] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:33 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:34.422075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:34.422917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:34.429430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.430041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.430578 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.431292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.431866 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.432397 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.460920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:53:34.871120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ac049d90-eed1-4053-8a65-1395d3a80032 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 204 len: 0 microversion: 2.1 time: 0.453736 Aug 29 23:53:34.872118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 87/180] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:53:34 2022] DELETE /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:53:34.884371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:34.894540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:34.894540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.894867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.895645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.897358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.898173 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.898952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.215248 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.231229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0b583eaa-2d78-4bd2-a5ca-63b3f503530d tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1553 microversion: 2.1 time: 0.352133 Aug 29 23:53:35.232006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 94/181] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:34 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:35.267074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:35.268367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:35.275295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.275731 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.276166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.277066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.277534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.277948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.474252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.483748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-245fb60c-31c9-4f9a-88a2-c8ad26b6c319 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.223987 Aug 29 23:53:35.484478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 88/182] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:35 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:36.267885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:36.268887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:36.278523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.279462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.280057 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.281433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.281433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.282615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.469324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.486458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7e3528b4-e7bb-48ed-a1a9-61aa4d535320 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1553 microversion: 2.1 time: 0.224731 Aug 29 23:53:36.488095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 95/183] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:36 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:36.517944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:36.520851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:36.527624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.528118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.528585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.529342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.529796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.530806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.742240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.752928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6a68c26d-d245-47b7-a886-4fb3efb8db53 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.243656 Aug 29 23:53:36.753813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 89/184] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:36 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:37.512390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:37.513799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:37.524717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.525641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.526527 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.527732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.528547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.529279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.726481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:37.742824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5fbbe9ea-c62e-4f92-ba3f-522f4d94fc73 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1553 microversion: 2.1 time: 0.235929 Aug 29 23:53:37.744238 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 96/185] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:37 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:37.801544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:37.809243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:37.829082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.830449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.831685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.833807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.834896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.835937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.150100 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.165386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7de2203a-17f6-440b-a7c3-cc484237db1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.378585 Aug 29 23:53:38.166243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 90/186] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:37 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:38.356007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369a844-afb7-41b8-93e0-822cc05c3da2", "name": "network-vif-deleted", "tag": "301565fd-38df-4687-ab85-0e577c9b30a7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:38.365151 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.365645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.366086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.407937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] Creating event network-vif-deleted:301565fd-38df-4687-ab85-0e577c9b30a7 for instance 2369a844-afb7-41b8-93e0-822cc05c3da2 on hv-cinder-85504 Aug 29 23:53:38.419301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-7e6bcb89-e0d7-49c7-aaf8-8490b39fadc7 req-3367f5b2-233f-4636-a460-cde90b521b93 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070957 Aug 29 23:53:38.430906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 97/187] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:38.770566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:38.772039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:38.783783 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.784995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.785797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.787292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.788426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.789210 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.918585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.931551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c45e1b66-f982-4922-85ba-6941124a4880 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1345 microversion: 2.1 time: 0.168308 Aug 29 23:53:38.946220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 91/188] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:38 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:39.190349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:39.191800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:39.199684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.200203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.200635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.201343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.201788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.203015 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.227549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:39.411300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:39.429296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-91c72a0d-f393-4979-a39f-ff83bfc36898 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.245163 Aug 29 23:53:39.430622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 98/189] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:39 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:39.970294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:39.971155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:39.977940 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.978434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.978870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.979600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.980057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.980530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.034092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.034935 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.035730 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.036634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lazy-loading 'fault' on Instance uuid 2369a844-afb7-41b8-93e0-822cc05c3da2 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:53:40.122959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4fddfb77b14b16a65314b3aff68930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651125f8b5f9452a8f854ae229670514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.140713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-79ea8448-2ac8-4002-8461-18f744feccc3 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 200 len: 1350 microversion: 2.1 time: 0.174917 Aug 29 23:53:40.142167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 92/190] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:39 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 1350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:40.457301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:40.458970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:40.465891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.466373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.466802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.468375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.468714 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.469348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.658357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.666935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-347d0a2d-ac85-4fea-ac18-5bd42d6f49a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.214609 Aug 29 23:53:40.667690 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 99/191] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:40 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:41.183095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:41.184164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:41.195737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.196608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.197539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.198577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.204542 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.204542 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.229789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] HTTP exception thrown: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Request method failure captured: Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 HTTP/1.1 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE8tOyhuqjtc-ntVvIpmY41jeDqwU7cwxPQ6rhrQSKijy28htDxCSglt8H08hJydlSbxLId_evcBgruASbPG_zVtEdIB8MtFRZxQsXMVREqymIzX4Xmj5VNaPaw1eT1JTpo7VHYdGx3PyiI3zQRs2-iP70qeBjK1QA25kdKzSLngJ4 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:53:41.239901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/651125f8b5f9452a8f854ae229670514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_651125f8b5f9452a8f854ae229670514", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}] Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 4c4fddfb77b14b16a65314b3aff68930 Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.241531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '2369a844-afb7-41b8-93e0-822cc05c3da2'} Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:41.242306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.243498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.244722 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Returning 404 to user: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:41.244722 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-da397fcd-a5b7-4edd-ad33-c55ad0d81aee tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 404 len: 111 microversion: 2.1 time: 0.066966 Aug 29 23:53:41.248804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 93/192] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:41 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:53:41.424253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:41.426524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:41.435950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.437380 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.437846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.438785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.439338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.439878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.455512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] HTTP exception thrown: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Request method failure captured: Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2/os-volume_attachments HTTP/1.1 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE8tOyhuqjtc-ntVvIpmY41jeDqwU7cwxPQ6rhrQSKijy28htDxCSglt8H08hJydlSbxLId_evcBgruASbPG_zVtEdIB8MtFRZxQsXMVREqymIzX4Xmj5VNaPaw1eT1JTpo7VHYdGx3PyiI3zQRs2-iP70qeBjK1QA25kdKzSLngJ4 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:53:41.461887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/651125f8b5f9452a8f854ae229670514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_651125f8b5f9452a8f854ae229670514", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}] Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 4c4fddfb77b14b16a65314b3aff68930 Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.469488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'server_id': '2369a844-afb7-41b8-93e0-822cc05c3da2'} Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:41.470717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:41.473003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:41.475286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Returning 404 to user: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:41.475286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-52bb1ba3-71d4-44b0-8eb6-f9eb3e06c657 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045910 Aug 29 23:53:41.475286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 100/193] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:53:41 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:53:41.691215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:41.692022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:41.700287 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.700784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.701362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.702992 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.703762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.704384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.710603 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:41.879109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:41.887850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63148c65-f40d-47d9-bcc2-2adddada57ce tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.201419 Aug 29 23:53:41.888487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 94/194] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:41 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:42.925288 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:42.926545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:42.930621 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=63 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:42.939386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:42.940119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:42.940726 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:42.941747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:42.942348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:42.942874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.115681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:43.116670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:43.134649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:43.138215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.138948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.140869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.141277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.146305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.147485 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.153794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3b5a3c34-1a82-4b0d-ad9d-24fed469e39b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.236226 Aug 29 23:53:43.154563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 101/195] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:42 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:43.171585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] HTTP exception thrown: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Request method failure captured: Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 HTTP/1.1 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE8tOyhuqjtc-ntVvIpmY41jeDqwU7cwxPQ6rhrQSKijy28htDxCSglt8H08hJydlSbxLId_evcBgruASbPG_zVtEdIB8MtFRZxQsXMVREqymIzX4Xmj5VNaPaw1eT1JTpo7VHYdGx3PyiI3zQRs2-iP70qeBjK1QA25kdKzSLngJ4 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:53:43.173637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/651125f8b5f9452a8f854ae229670514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_651125f8b5f9452a8f854ae229670514", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}] Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 4c4fddfb77b14b16a65314b3aff68930 Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.176132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '2369a844-afb7-41b8-93e0-822cc05c3da2'} Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:43.177628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.179869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.182310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Returning 404 to user: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:43.182310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a5e06ced-059c-4624-a954-5444e5826486 tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 404 len: 111 microversion: 2.1 time: 0.066160 Aug 29 23:53:43.182310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 95/196] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:53:43 2022] DELETE /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:53:43.186735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:43.187799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] [instance: 2369a844-afb7-41b8-93e0-822cc05c3da2] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:43.194940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.198345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.198345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.198345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.198345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.198923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.216037 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] HTTP exception thrown: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Request method failure captured: Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 HTTP/1.1 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE8tOyhuqjtc-ntVvIpmY41jeDqwU7cwxPQ6rhrQSKijy28htDxCSglt8H08hJydlSbxLId_evcBgruASbPG_zVtEdIB8MtFRZxQsXMVREqymIzX4Xmj5VNaPaw1eT1JTpo7VHYdGx3PyiI3zQRs2-iP70qeBjK1QA25kdKzSLngJ4 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:53:43.219229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/651125f8b5f9452a8f854ae229670514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_651125f8b5f9452a8f854ae229670514", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/651125f8b5f9452a8f854ae229670514"}]}] Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 651125f8b5f9452a8f854ae229670514 Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147741297 Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 4c4fddfb77b14b16a65314b3aff68930 Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-DeleteServersTestJSON-1147741297-project Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.222013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '2369a844-afb7-41b8-93e0-822cc05c3da2'} Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:43.223119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. Aug 29 23:53:43.225601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.228830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] Returning 404 to user: Instance 2369a844-afb7-41b8-93e0-822cc05c3da2 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:43.228830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6cba91ab-ef23-43ba-94fc-84fa70ae337f tempest-DeleteServersTestJSON-1147741297 tempest-DeleteServersTestJSON-1147741297-project] 10.222.0.90 "GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2" status: 404 len: 111 microversion: 2.1 time: 0.039519 Aug 29 23:53:43.228830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 102/197] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:43 2022] GET /compute/v2.1/servers/2369a844-afb7-41b8-93e0-822cc05c3da2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:53:44.182592 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:44.183953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:44.187903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:44.198307 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.199437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.200294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.203004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.204550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.205736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.504786 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:44.522278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-104b640d-7d12-4d53-854b-3a15a1d1eb7c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.346999 Aug 29 23:53:44.523605 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 96/198] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:44 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:45.562968 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:45.563737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:45.571865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:45.572425 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:45.572874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:45.573589 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:45.574044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:45.574466 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:45.825004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.842759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ec73692a-908d-4a5d-b6ea-ca1bc7eea326 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.286282 Aug 29 23:53:45.843721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 103/199] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:45 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:46.866621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:46.873118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:46.876127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.876768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.877268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.878231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.878851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.879342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.148394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.158612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2b3e06bc-69df-4150-bdf0-4cbb37786177 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.296819 Aug 29 23:53:47.159217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 97/200] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:46 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:48.182646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.189729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.197737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.198342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.198846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.199836 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.200421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.200967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.537214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:48.549868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-970e2608-a067-42ad-97a7-6aedcea43c4b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.371789 Aug 29 23:53:48.551231 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 104/201] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:49.584370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:49.585754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:49.593324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:49.593818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:49.594251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:49.595318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:49.595423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:49.596148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:49.802951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.814285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-51bd782e-c933-465e-9f83-b95214132bbe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.233789 Aug 29 23:53:49.815023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 98/202] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:49 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:50.836971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:50.837520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:50.844688 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.845187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.845626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.846423 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.846950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.847525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.030051 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:51.038922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-80d563dd-2306-44e4-998a-cebb516b9659 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.206135 Aug 29 23:53:51.039496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 105/203] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:50 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:52.066298 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:52.067633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:52.082731 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:52.083920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:52.084951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:52.086676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:52.087494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:52.088240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:52.405057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:52.427128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-890a9af2-1da8-484f-a7df-c27b05f5da55 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.367986 Aug 29 23:53:52.433697 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 99/204] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:52 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:53.469060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:53.472007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:53.493435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.496718 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.497117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.499338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.501345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.502454 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.708952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:53.718163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fabae90f-6975-4779-8e8f-5b6addc23f2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.258321 Aug 29 23:53:53.718737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 106/205] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:53 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:54.758405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:54.765228 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:54.778121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:54.779167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:54.780239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:54.781801 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:54.782716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:54.783474 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.027608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:55.042999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-22c20e2f-2790-4927-8430-042e4287a42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.292826 Aug 29 23:53:55.044023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 100/206] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:54 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:56.087646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:56.090728 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:56.110241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:56.112787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:56.114285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:56.115504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:56.116339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:56.118367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:56.383369 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:56.400477 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-90cfd39a-0220-4def-bc84-ec78e62f7567 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.325456 Aug 29 23:53:56.417095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 107/207] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:56 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:57.437473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:57.442151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:57.466285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.467544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.468323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.469272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.469895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.470478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.750445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:57.759885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-55e69321-0635-42bd-9d02-550da73892c0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.330077 Aug 29 23:53:57.760546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 101/208] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:57 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:58.791508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:58.792265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:58.799954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:58.819633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:58.819633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:58.819633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:58.819633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:58.820046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:58.956120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.964937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2ddcbd91-3a70-4ad6-ae8b-a779858c8c78 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.177187 Aug 29 23:53:58.965766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 108/209] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:58 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:59.995570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:59.998398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:00.010475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:00.012110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:00.014192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:00.017204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:00.018243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:00.019119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:00.377261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.396489 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9a52b2b2-2aa6-43cf-a2ef-fe19532fdb8f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.410606 Aug 29 23:54:00.398212 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 102/210] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:59 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:01.434311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:01.439129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:01.452854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.453952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.454928 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.456225 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.457077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.458398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.984074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:02.002643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2e9e2f95-dec5-4d25-aadd-032e09944a75 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.570455 Aug 29 23:54:02.002643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 109/211] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:01 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:03.043728 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:03.044804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:03.062839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:03.064205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:03.065239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:03.066711 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:03.067776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:03.068790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:03.398073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:03.414989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-911d2de3-567c-450f-b877-f7a5b9ab57df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.377650 Aug 29 23:54:03.415625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 103/212] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:03 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:04.454865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:04.459125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:04.477063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.477577 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.481577 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.486264 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.486784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.487214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.814618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.821324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-14926083-2347-4fcf-9fa4-4bf1385d178e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.382394 Aug 29 23:54:04.836243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 110/213] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:04 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:05.873425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:05.873973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:05.888802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.890522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.891922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.893753 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.894713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.895660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.154454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.168778 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ed1378ea-2bf5-4bc0-ba49-36c48a5d9f98 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1522 microversion: 2.1 time: 0.308604 Aug 29 23:54:06.171027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 104/214] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:05 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:07.193781 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:07.195114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:07.215460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.215460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.215460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.215460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.216727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.216727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.463535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.478674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-932e2f24-b505-4443-91d6-4cce406e4261 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1502 microversion: 2.1 time: 0.289984 Aug 29 23:54:07.501795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 111/215] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:07 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:07.507732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:07.508596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:07.515773 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.516324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.516840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.517998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.518694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.519215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.757590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.774163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-efeec5ba-3e55-44de-a2ff-0f71a872da8a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1514 microversion: 2.1 time: 0.270466 Aug 29 23:54:07.775153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 105/216] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:07 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:08.852435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-897650247", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "networks": [{"uuid": "c2c3299b-0403-418b-997c-2b2e94887975"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:08.931928 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] validate_networks() for [('c2c3299b-0403-418b-997c-2b2e94887975', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:09.417696 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:09.418233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:09.418806 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:09.420277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:09.420820 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:09.433323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.434104 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.435897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.437718 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.438519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.439230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.468875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Getting quotas for project a9642272967c46b188cf1bced9ea6ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:09.474677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Getting quotas for user 49f2bdc1ced843d7afd419e7e5b7d4e5 and project a9642272967c46b188cf1bced9ea6ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:09.494688 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:09.497954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:09.704376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a8b7ff42-0b83-4285-ba18-f9efba550a4b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858014 Aug 29 23:54:09.705208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 112/217] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:54:09.725685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4088f658-e3c2-495a-8dcb-dd5ee3ce84da tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:09.727002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4088f658-e3c2-495a-8dcb-dd5ee3ce84da tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:09.827413 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4088f658-e3c2-495a-8dcb-dd5ee3ce84da tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:09.845288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4088f658-e3c2-495a-8dcb-dd5ee3ce84da tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1213 microversion: 2.1 time: 0.128906 Aug 29 23:54:09.846903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 106/218] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:09 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:10.088266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:10.092049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:10.101684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.102411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.103124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.104814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.105406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.105993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.162382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'flavor' on Instance uuid 94c9c11e-d575-4b60-be05-fe0a27272eac {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:10.558208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:10.672122 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1841af54-f2bf-46d3-b788-ecf787d71ac9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/action" status: 200 len: 32 microversion: 2.1 time: 0.590855 Aug 29 23:54:10.674317 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 113/219] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:10 2022] POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/action => generated 32 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 23:54:10.684411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:10.686503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:10.695255 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.695978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.696641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.703285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.703285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.703285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.881370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.884943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-835b8bfc-53ea-4634-b776-454e7f8c2ba2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:10.885649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-835b8bfc-53ea-4634-b776-454e7f8c2ba2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:10.904104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-24eee66a-ab65-4939-b9f6-e4e95afdc85c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.223361 Aug 29 23:54:10.905315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 107/220] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:10 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:10.954117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-835b8bfc-53ea-4634-b776-454e7f8c2ba2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.962139 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-835b8bfc-53ea-4634-b776-454e7f8c2ba2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1213 microversion: 2.1 time: 0.094320 Aug 29 23:54:10.963758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 114/221] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:10 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:11.948993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:11.948993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:11.961117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.962005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.962838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.964072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.970497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.970497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.989709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:11.995537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:12.007872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:12.009033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:12.017028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.017028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:12.017028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:12.017028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.127686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.143682 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0fc15ed2-0577-4325-b965-4bae8652af9f tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1217 microversion: 2.1 time: 0.160197 Aug 29 23:54:12.144910 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 115/222] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:11 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:12.205733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.214315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70271d59-832d-47f0-9298-829ab4a6f462 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.275672 Aug 29 23:54:12.214987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 108/223] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:11 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:13.046368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:13.047267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:13.054956 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.055442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.055871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.056666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.057115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.057528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.084734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e7032af2-b7ef-45eb-9407-d4193ef3edc3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/ips" status: 200 len: 152 microversion: 2.20 time: 0.043211 Aug 29 23:54:13.085511 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 116/224] 10.222.0.90 () {60 vars in 1289 bytes} [Mon Aug 29 23:54:13 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:54:13.179523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:13.180237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:13.188561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.189055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.189481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.190195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.190655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.191058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.242186 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:13.243792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:13.247541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:13.254926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.255451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.255893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.256724 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.257323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.257797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.272719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.283553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-96f4460c-a496-4c06-9639-72c019a92e52 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1217 microversion: 2.1 time: 0.108022 Aug 29 23:54:13.284288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 109/225] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:13 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:13.447926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.460678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-aad8be3a-6c96-447b-884f-1df151a3f05a tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.226095 Aug 29 23:54:13.461547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 117/226] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:13 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:14.305110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:14.305782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:14.313755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.314554 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.314990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.315966 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.316453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.317067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.393599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:14.396963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=89 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:14.404887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c812ed8d-07c5-4d13-b1f4-5d292ede8811 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1209 microversion: 2.1 time: 0.103674 Aug 29 23:54:14.407750 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 110/227] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:14 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:14.484399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:14.485149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:14.491952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.492402 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.492842 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.493570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.494035 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.494517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.645303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:14.654103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-58694cbf-924f-43b4-95a1-68bffdf54524 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.174933 Aug 29 23:54:14.668208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 118/228] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:14 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:15.444073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:15.455027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:15.474247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.475516 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.477632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.479134 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.480015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.480853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.585648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.596565 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5506e9f3-e7b4-4788-98c2-c811255e775b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1265 microversion: 2.1 time: 0.161120 Aug 29 23:54:15.597788 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 111/229] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:15 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:15.683412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:15.686525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:15.699644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.702073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.703071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.704715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.706067 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.707242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.141040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.161342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c16b9cc5-ca31-4290-bc15-2a5924ca5bc1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.486291 Aug 29 23:54:16.162894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 119/230] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:15 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:16.238060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:16.238591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.246200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.250464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.250464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.250464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.250464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.250861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.275944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lazy-loading 'flavor' on Instance uuid 39819963-dd3d-4079-a0a1-d21a46d4a420 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:16.632623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:16.633939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.649220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.650148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.650650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.651647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.652336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.652922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.724693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.735719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a1a0c639-bd43-4aca-bb5f-0deeffe44c0c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1271 microversion: 2.1 time: 0.110183 Aug 29 23:54:16.736374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 120/231] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:16 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:16.803214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7b0344cf-b8d5-45f9-9f5f-f1178ed1cc5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/action" status: 202 len: 0 microversion: 2.20 time: 0.569708 Aug 29 23:54:16.803816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 112/232] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 23:54:16 2022] POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:54:16.814800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:16.819682 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.821832 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.822319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.822754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.823452 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.823903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.824355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.009749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.018795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.020333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.021513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cfb68d30-4928-4440-b740-cb19e4ea4221 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.213216 Aug 29 23:54:17.022083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 121/233] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:16 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:17.188555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:17.189877 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:17.192962 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=36 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:17.199393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.199952 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.201968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.202728 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.203185 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.203614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.401125 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.412046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-91496384-5b84-4cd5-adfa-5e8df073683f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.230557 Aug 29 23:54:17.414456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 113/234] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:17 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:17.766527 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:17.768674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:17.796252 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.797279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.798221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.800054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.801257 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.802125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.002065 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.013290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b52da85e-6b79-422a-84ec-635c853abe07 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.257607 Aug 29 23:54:18.013904 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 122/235] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:17 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:18.054284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:18.056806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:18.066206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.066671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.067837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.069139 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.069139 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.069453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.117484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8939c9d1-b864-4a13-affa-225f4a46a59b", "tag": "21cea2d3-9c53-4a27-ba19-887adc4418cb"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:18.129595 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.130161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.133439 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.146276 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] Creating event network-changed:21cea2d3-9c53-4a27-ba19-887adc4418cb for instance 8939c9d1-b864-4a13-affa-225f4a46a59b on hv-cinder-85504 Aug 29 23:54:18.151907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-ffb7eb7f-8ab9-4b34-a938-6c55cae93a90 req-ba623c21-3a24-4326-8a6a-dda049ec2fb9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038192 Aug 29 23:54:18.162394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 123/236] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:18.261894 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.270968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.272506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.273785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-238f8fb8-36b7-4c1e-9f6b-5f7c880b9b6d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.231263 Aug 29 23:54:18.274347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 114/237] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:18 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:18.439767 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:18.440849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:18.448816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.450534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.451568 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.453739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.455024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.455768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.673287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.696342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-114ce469-f0fc-4a32-8423-fdf91b1e718b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.248812 Aug 29 23:54:18.696342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 124/238] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:18 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:19.037784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:19.038547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:19.049014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.049918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.050350 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.051294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.051936 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.052395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.277806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.300833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:19.302262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:19.303906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f05da701-bb5b-4c37-8af7-596a3c423dfc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.270239 Aug 29 23:54:19.306388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 115/239] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:19 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:19.322119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.323003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.324637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.330600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.331400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.331918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.455889 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:19.526379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.535779 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.537296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.538539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-168853af-1711-4e41-91d1-24cdeebc6ed1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.244796 Aug 29 23:54:19.539155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 125/240] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:19 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:19.706636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:19.707227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:19.714937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.715498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.716736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.722919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.722919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.722919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.836559 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:19.902429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.919776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0d1c72af-7805-4a94-8f68-47d079968848 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.215769 Aug 29 23:54:19.921240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 116/241] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:19 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:20.337091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.337897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.345615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.346556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.347033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.347814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.348399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.348890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.573459 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.576146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.578767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.593605 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.594973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.596432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.600425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.601912 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.603195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.603872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a3766f75-a38e-403e-9575-efbdfa726cae tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.271326 Aug 29 23:54:20.614657 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 126/242] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:20.640210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.640710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.652758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.653435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.654063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.655251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.655785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.656300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.697015 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8060ffdb-dffd-4144-9f54-81d53972886c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/ips" status: 200 len: 150 microversion: 2.1 time: 0.065273 Aug 29 23:54:20.697703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 127/243] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:20.850375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.863304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.865349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.871400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-defb5cf2-36fd-4956-825a-ef5a6f96ef90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.304035 Aug 29 23:54:20.871400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 117/244] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:20.945002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.946120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.960060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=8 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:20.962930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.963574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.964218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.965540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.966879 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.968334 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.244783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.264567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f4a85408-45f2-49bb-ab1a-9a73fae7c23b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.323451 Aug 29 23:54:21.265574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 128/245] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:21.634637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:21.634637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:21.640785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.641331 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.641776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.642504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.642984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.643407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.913629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:21.914745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:21.935373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.954287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.955572 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.955809 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-87280fec-dd32-45c6-b129-b5e43425694e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.328894 Aug 29 23:54:21.956707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.958407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 118/246] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:21 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:21.962730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.962730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.962730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.169326 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:22.178431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:22.179880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:22.181085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-31e13d6a-91c1-48ab-9105-9291cf3bad8c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.277060 Aug 29 23:54:22.181639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 129/247] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:21 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:22.286942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:22.287547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:22.294440 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.295204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.295641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.296368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.296818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.297236 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.509359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:22.517913 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-00045d0e-20c3-4b84-8030-9372ca49cd2e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.234884 Aug 29 23:54:22.518502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 119/248] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:22 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:22.687915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189075e3-d732-422f-828c-5ac936e7eb90"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:22.690639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:22.698140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.698627 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.699053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.699812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.700629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.702952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.978906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:22.979504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:22.986037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.986529 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.986970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.989550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.989550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.990053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.212806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.229267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4f967f36-cd1d-4579-9587-19448c840fa0 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.252779 Aug 29 23:54:23.231507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 120/249] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:22 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:23.240580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:23.241769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:23.253133 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.253988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.254864 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.257117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.258227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.259005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.459153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.468149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.469675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.470766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6cbd967c-2dae-417b-ab9e-f6e144f2adf0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.237660 Aug 29 23:54:23.471747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 121/250] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:23 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:23.476088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8939c9d1-b864-4a13-affa-225f4a46a59b", "name": "network-vif-plugged", "status": "completed", "tag": "21cea2d3-9c53-4a27-ba19-887adc4418cb"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:23.485919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.486395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.486817 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.498314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] Creating event network-vif-plugged:21cea2d3-9c53-4a27-ba19-887adc4418cb for instance 8939c9d1-b864-4a13-affa-225f4a46a59b on hv-cinder-85504 Aug 29 23:54:23.503231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a7d0650c-92ed-4883-b620-9841f8fef205 req-767fe01c-5699-4d6b-a4d6-5facf9e3b6e4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030425 Aug 29 23:54:23.503831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 122/251] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:23.539549 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:23.540588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:23.566178 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.567132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.567704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.568958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.569741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.571049 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.743959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.755644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-313b408c-11fa-4360-add4-6dd3674e7605 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.220549 Aug 29 23:54:23.756341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 123/252] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:23 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:23.779308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-591d775c-e8c4-4b26-af4f-3062f137cd4f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.096475 Aug 29 23:54:23.780725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 130/253] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:54:22 2022] POST /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 194 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:24.252245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.252823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.260523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.263845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.264584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.265295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.265759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.266183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.475983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.485652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a219ae6f-8024-4f69-8c04-a770da030a0b tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1313 microversion: 2.1 time: 0.238221 Aug 29 23:54:24.486157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 124/254] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:24.501564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.502299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.516570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.517342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.517966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.518882 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.519458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.519991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.536899 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:24.551350 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.552053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.560486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.560981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.561412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.562149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.562595 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.563637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.610568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-461131f0-1edb-4895-be5f-6b175f8380dd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/ips" status: 200 len: 145 microversion: 2.1 time: 0.062858 Aug 29 23:54:24.611825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 125/255] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:24.736764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.745570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.748012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.749363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-83ab9a2d-9197-4f4f-b58d-3f3250c1eab4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.253143 Aug 29 23:54:24.750007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 131/256] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:24.778152 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.778755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.784929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.785464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.785899 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.786660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.787114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.787533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.804868 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:24.975034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.982925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aeb4eca2-ba1d-415b-9c94-15260bb4509c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.208997 Aug 29 23:54:24.983505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 126/257] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:25.517725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.518656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:25.534259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.535133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.536059 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.537617 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.538040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.538729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.702922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:25.715287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7c46f228-ded1-487e-b6e7-20b76a5e1386 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1496 microversion: 2.1 time: 0.209652 Aug 29 23:54:25.717498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 132/258] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1496 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:25.774391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.775105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:25.782061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.782548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.782974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.783683 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.784131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.784892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.003821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.004647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:26.006017 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:26.014773 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.016721 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.018031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-baa7be75-bfd3-40a7-aecc-ccdcf5e6046d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.248644 Aug 29 23:54:26.018793 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 127/259] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:26.021233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:26.021959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:26.024090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.024090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:26.024090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:26.024090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.246507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.257049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0ed392fe-2f7a-4901-8588-2965e35819d8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.256126 Aug 29 23:54:26.257848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 133/260] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:27.044816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.045429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.053854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.053854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.053854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.053854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.054314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.054314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.219165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.235285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.238999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.241610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c307c6ef-445c-4320-b40b-c65bcf8afd96 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.202036 Aug 29 23:54:27.242739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 128/261] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:27 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:27.286944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.290569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.304322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.305414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.306455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.307827 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.309410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.310574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.529420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.539887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-69c7e9ab-109d-40eb-8ff8-321599d8b4ca tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.263694 Aug 29 23:54:27.540528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 134/262] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:27 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:27.841460 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.841870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.848454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.849187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.849767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.850645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.851267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.851692 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.882348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:54:28.266659 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.267684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.278305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.279447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.280035 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.281456 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.282233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.283295 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.382843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a950b3fa-09f9-4a4d-8fd5-89486e781561 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 204 len: 0 microversion: 2.1 time: 0.545306 Aug 29 23:54:28.383662 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 129/263] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:54:27 2022] DELETE /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:54:28.396654 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.397409 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.404371 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.405791 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.406237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.407240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.407708 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.408133 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.468556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.477392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.478837 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.480045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c1e5ba81-a929-4d31-aa8c-20c28455da5f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.218235 Aug 29 23:54:28.480685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 135/264] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:28.572004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.572811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.580210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.580838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.581337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.585107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.585107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.585107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.747136 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.770360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bca47d3f-eb5f-44e7-9005-7a7cf23ae503 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1502 microversion: 2.1 time: 0.379557 Aug 29 23:54:28.771517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 130/265] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:28.805181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edc1af7-22ce-4511-b377-a5110eba0157"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:28.810198 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.828067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.828966 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.829980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.831397 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.832458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.833703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.894673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.904030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b228919e-519e-4591-88a8-5a34fddbbcde tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.342932 Aug 29 23:54:28.904640 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 136/266] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:28.909619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1922713929", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "networks": [{"uuid": "54b35e90-eaee-4696-a0d1-a7792bb4e65e"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:28.969313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] validate_networks() for [('54b35e90-eaee-4696-a0d1-a7792bb4e65e', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:29.367124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:29.367592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:29.368036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:29.368523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:29.368931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:29.378716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.379270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.379727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.395605 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.397512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.397962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.445119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Getting quotas for project 184afafb4d0b4a089a059eb73eb6ff2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:29.458207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Getting quotas for user c200edfeb8a649f0a1d5a48f837c023a and project 184afafb4d0b4a089a059eb73eb6ff2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:29.495215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:29.499406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:29.627055 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fba53c67-0886-4149-9fe2-58752367c106 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720816 Aug 29 23:54:29.628165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 137/267] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:54:29.650013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.650530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:29.660522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.661005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.661436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.662135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.662590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.663008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.843308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.866431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.870497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.874245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b9980ea2-308d-4f13-97e9-c04396deb63f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.244180 Aug 29 23:54:29.891728 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 138/268] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:29.929680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-77194d3b-f9af-4a05-b6a0-d1ee16ea8e5a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.929680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-77194d3b-f9af-4a05-b6a0-d1ee16ea8e5a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:29.977678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-77194d3b-f9af-4a05-b6a0-d1ee16ea8e5a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.985608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-77194d3b-f9af-4a05-b6a0-d1ee16ea8e5a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1219 microversion: 2.1 time: 0.092332 Aug 29 23:54:29.986223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 139/269] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:29.992732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.993634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:30.000299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.030147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.030147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.030147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.030147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.033412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.160976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:30.169839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0f1fcf28-7224-43c7-9fc5-31ac643192a2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1502 microversion: 2.1 time: 0.180756 Aug 29 23:54:30.170539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 140/270] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:30.175585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:30.176215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:30.182724 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.183855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.184352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.185155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.185622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.186044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.350924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:30.359044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f093b349-3573-4b92-a6a5-a893acd55504 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.187483 Aug 29 23:54:30.359607 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 141/271] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:30 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:30.503658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8939c9d1-b864-4a13-affa-225f4a46a59b", "name": "network-vif-deleted", "tag": "21cea2d3-9c53-4a27-ba19-887adc4418cb"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:30.514025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.514646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.515574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.532384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] Creating event network-vif-deleted:21cea2d3-9c53-4a27-ba19-887adc4418cb for instance 8939c9d1-b864-4a13-affa-225f4a46a59b on hv-cinder-85504 Aug 29 23:54:30.539056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-ad3e578c-2e18-49a1-a452-5bd8ae5fc932 req-1ddb35f4-15a3-4e43-8ba3-a9b5ec6f5f2e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Aug 29 23:54:30.546693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 142/272] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:30.746291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-483d6a75-73e7-41ab-8f8a-7b5a79189428 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.959781 Aug 29 23:54:30.746875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 131/273] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:54:28 2022] POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments => generated 194 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:30.910189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:30.911624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:30.919329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.920629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.921447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.924736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.930545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.930545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.007352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8c4f43ea-05c8-489e-ac0a-aac6eef53b44 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:31.008361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8c4f43ea-05c8-489e-ac0a-aac6eef53b44 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:31.075884 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8c4f43ea-05c8-489e-ac0a-aac6eef53b44 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.085996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8c4f43ea-05c8-489e-ac0a-aac6eef53b44 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1219 microversion: 2.1 time: 0.083003 Aug 29 23:54:31.086781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 132/274] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:31 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:31.117600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.129671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.131217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.132328 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cbc99154-69cb-45d3-83ef-066d45cb152f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.226734 Aug 29 23:54:31.132982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 143/275] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:30 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:31.193220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:31.193874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:31.204579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.205067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.205841 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.206639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.207336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.208245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.311446 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.321763 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8eebf50a-d34f-42f6-98c4-6d1a2c1e6332 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1298 microversion: 2.1 time: 0.132268 Aug 29 23:54:31.337463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 133/276] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:31 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:31.385203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:31.400353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:31.400353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.400353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.400353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.400944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.400944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.400944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.598823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.598823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b92b67e6-c861-4961-8adb-fc3187a79276 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.175680 Aug 29 23:54:31.598823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 144/277] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:31 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:32.107981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.108618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.115229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.115708 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.116140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.116853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.117290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.117789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.157266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.158410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.170485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.177716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.177716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.177716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.177716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.178093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.235385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.238646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a472989d-c7cb-4312-8aa6-ac544412667a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1223 microversion: 2.1 time: 0.134971 Aug 29 23:54:32.239504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 134/278] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:32.359810 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.360380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.366959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.367453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.367885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.368640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.369093 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.369600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.379874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.389091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.390569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.391877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7d5ca040-eb5a-4300-a398-37d69bbc2d73 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.239395 Aug 29 23:54:32.392510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 145/279] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:32.416117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.416874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.417431 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.418688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lazy-loading 'fault' on Instance uuid 8939c9d1-b864-4a13-affa-225f4a46a59b {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:32.513932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.528385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-07691824-e46c-40a9-b3a5-7ae24201c6d3 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1303 microversion: 2.1 time: 0.172856 Aug 29 23:54:32.533959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 135/280] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:32.617009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.618054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.629933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.630432 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.630863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.631662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.633706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.633706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.940925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bef05549-bc43-432e-8c38-46412a18225f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: .version_select at 0x7fd5a671d5e0>, body: {"keypair": {"name": "tempest-keypair-1666743028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcuc8KI3IkX9PrkhHwNEgC7SBfYqjUTZZptCR9DUmIlGIjq7YM2ztXH5Te5FmuIZLZZmA6kDflU1qYoT0118XKjlt30vEkHOuxFYdxOnTAJnAr4Vp2XhMsFlQ/8eO4QaA=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:32.945224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.957048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d8c60dd6-b6f3-440f-af6a-899b1f4c44e9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.344810 Aug 29 23:54:32.957655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 146/281] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:32.993843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-bef05549-bc43-432e-8c38-46412a18225f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:33.000897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-bef05549-bc43-432e-8c38-46412a18225f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:33.113235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bef05549-bc43-432e-8c38-46412a18225f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176625 Aug 29 23:54:33.120891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 136/282] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:54:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:33.275204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.276562 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.289772 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.290286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.290738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.291449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.291918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.292388 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.437968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.439364 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.452372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.452886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.453313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.454255 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.454805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.455229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.466865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:33.482225 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5672446e-eee9-4230-8725-79f1a7815a85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1271 microversion: 2.1 time: 0.211543 Aug 29 23:54:33.482945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 147/283] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:33.587972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.593269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.627849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.630453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.635248 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.637254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.638556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.642736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.700926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.701392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.702023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.702869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lazy-loading 'fault' on Instance uuid 8939c9d1-b864-4a13-affa-225f4a46a59b {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:34.087887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.117405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7d6b92ce-0fcc-498c-9c2c-849a24c566ff tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 200 len: 1303 microversion: 2.1 time: 0.539284 Aug 29 23:54:34.136801 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 148/284] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 1303 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:34.147835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:34.151697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.165557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.166352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.167542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.169305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.170046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.170413 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.228393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.252482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.258619 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.260847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-40eee206-c9ac-4cab-8d5b-5bbd84071415 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1743 microversion: 2.20 time: 0.826437 Aug 29 23:54:34.264624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 137/285] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1743 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:34.370106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.378657 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2d94fafb-78bd-4431-b8eb-43d1cb47c8f0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1500 microversion: 2.1 time: 0.239630 Aug 29 23:54:34.379243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 149/286] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:34 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1500 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:34.400363 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0a20e45-e555-45ae-81e4-0908084c2d34"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:34.402900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.416092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.416092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.416092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.416482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.417655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.418871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.468472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] HTTP exception thrown: Cannot 'attach_volume' instance 94c9c11e-d575-4b60-be05-fe0a27272eac while it is in vm_state rescued Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Request method failure captured: Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/os-volume_attachments HTTP/1.1 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 74 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFAIYASVtzH8JeVcHwa69nydl0Tv19W5_1V5CSGCBW2E6APPLk4OonL7nP5kECIVsOFEF893nArkpLrzBaoM5X9ifoM9ftGNiJFK0-wrERv83WNqg_QY270UP0YnhIyB4_DH7oiNKu7QKczKs6G0LKa6J9fMywaIJzHCkro-Bcy0i0 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:54:34.478637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dc817de5d4ef4812a2fee6ebe0895889", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}] Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 57998546e6a64d42ba3ded9f3267e6af Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {"volumeAttachment": {"volumeId": "a0a20e45-e555-45ae-81e4-0908084c2d34"}} Aug 29 23:54:34.482326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Cannot 'attach_volume' instance 94c9c11e-d575-4b60-be05-fe0a27272eac while it is in vm_state rescued Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'server_id': '94c9c11e-d575-4b60-be05-fe0a27272eac', 'body': {'volumeAttachment': {'volumeId': 'a0a20e45-e555-45ae-81e4-0908084c2d34'}}} Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:54:34.483747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 94c9c11e-d575-4b60-be05-fe0a27272eac while it is in vm_state rescued Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:34.486120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 94c9c11e-d575-4b60-be05-fe0a27272eac while it is in vm_state rescued Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Returning 409 to user: Cannot 'attach_volume' instance 94c9c11e-d575-4b60-be05-fe0a27272eac while it is in vm_state rescued {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cabfc43a-3069-450f-bb21-7ab41d2d2469 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079695 Aug 29 23:54:34.488451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 138/287] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:54:34.489385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:34.489385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.508352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.509254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.513009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.513815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.514304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.514736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.522152 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:34.528124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.529746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:34.538252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.538749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.539183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.539980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.540466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.540890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.616570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.627562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-daef34aa-dcc0-44e2-b3ea-9c483f6caa6e tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1271 microversion: 2.1 time: 0.123772 Aug 29 23:54:34.633154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 139/288] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:34 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:34.769338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4552d408-faa5-4f34-9c75-ee90fc19b911 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/action" status: 202 len: 0 microversion: 2.1 time: 0.285004 Aug 29 23:54:34.771227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 150/289] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:54:34.787849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:34.788702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.795392 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.795883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.796345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.797112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.797562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.797986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.953709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.966984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f5c50d49-4fae-4d9d-b3a3-85419a986df2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1508 microversion: 2.1 time: 0.191328 Aug 29 23:54:34.968656 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 140/290] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:34 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:35.147239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:35.149366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: 8939c9d1-b864-4a13-affa-225f4a46a59b] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.160656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.161427 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.162235 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.171621 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.178580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.181372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.225104 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] HTTP exception thrown: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Request method failure captured: Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b HTTP/1.1 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVGdbDhVpE_s6W7sKOGVKwjQDl6O510whpUuHlymZOwf6itKc-jtGun-_n56LFcUK1jE76Auz6owrn7cd9ScKxxU45Dlq7X9O4mQJuFRfSTi9nueBatQJc7xF-glP0RWZhLnnO4BLmZcUDpMuxwZyQARuGeSdDezCIo3PbyWNJ8oaBo Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a9642272967c46b188cf1bced9ea6ab5 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesActionsTest-1439290442 Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:54:35.228117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a9642272967c46b188cf1bced9ea6ab5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a9642272967c46b188cf1bced9ea6ab5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a9642272967c46b188cf1bced9ea6ab5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a9642272967c46b188cf1bced9ea6ab5"}]}] Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesActionsTest-1439290442 Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a9642272967c46b188cf1bced9ea6ab5 Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesActionsTest-1439290442 Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesActionsTest-1439290442-project Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 49f2bdc1ced843d7afd419e7e5b7d4e5 Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesActionsTest-1439290442-project Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. Aug 29 23:54:35.229641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '8939c9d1-b864-4a13-affa-225f4a46a59b'} Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:54:35.230409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. Aug 29 23:54:35.232629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:54:35.234463 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Returning 404 to user: Instance 8939c9d1-b864-4a13-affa-225f4a46a59b could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:54:35.234463 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5d5b25f4-808d-4199-82e6-3716e713a3e1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b" status: 404 len: 111 microversion: 2.1 time: 0.090158 Aug 29 23:54:35.234463 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 151/291] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/8939c9d1-b864-4a13-affa-225f4a46a59b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:54:35.294841 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:35.297724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.321172 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.325625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.326077 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.326833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.327446 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.329436 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.436848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1721528689", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "networks": [{"uuid": "c2c3299b-0403-418b-997c-2b2e94887975"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:35.506773 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] validate_networks() for [('c2c3299b-0403-418b-997c-2b2e94887975', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:35.711346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.743627 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.746889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.748693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c9877116-b898-4338-805d-af96602c6f54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1743 microversion: 2.20 time: 0.465112 Aug 29 23:54:35.749748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 141/292] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1743 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:35.755348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "name": "network-vif-plugged", "status": "completed", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:35.768341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.769135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.769938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.774482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:35.786760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] Creating event network-vif-plugged:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:54:35.800038 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-0d752b02-57be-490f-b7c9-9e77138c0aac req-b9b0eae6-f25e-4197-88f1-8490fbb60c08 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047096 Aug 29 23:54:35.803250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 142/293] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:35.813729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:35.814767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.828608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.835981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.836788 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.837550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.838168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.838633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.969968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.987570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e72ed96-89fc-4a91-ab54-42bbd3ed6efe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1277 microversion: 2.1 time: 0.182377 Aug 29 23:54:35.988834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 143/294] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:36.010706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.014755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.031206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.037744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.039277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.040875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.041898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.044469 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.396340 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:36.397046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:36.397304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:36.403591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:36.404285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:36.425082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.434107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.434107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.434107 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.448055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7a82b415-97ed-4935-9a6d-ad35800bf42d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1508 microversion: 2.1 time: 0.432453 Aug 29 23:54:36.448055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 144/295] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:36.448839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.448839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.448839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.493405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Getting quotas for project a9642272967c46b188cf1bced9ea6ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:36.504888 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Getting quotas for user 49f2bdc1ced843d7afd419e7e5b7d4e5 and project a9642272967c46b188cf1bced9ea6ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:36.519760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:36.522693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:36.538374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:36.664448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-159049c7-639d-4169-9c19-35429d9f0faf tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231339 Aug 29 23:54:36.665905 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 152/296] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:54:36.686075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b24a2000-e77f-4bdd-ad4e-24eeed2a38fe tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.687179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b24a2000-e77f-4bdd-ad4e-24eeed2a38fe tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.780802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b24a2000-e77f-4bdd-ad4e-24eeed2a38fe tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.792080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b24a2000-e77f-4bdd-ad4e-24eeed2a38fe tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1214 microversion: 2.1 time: 0.114477 Aug 29 23:54:36.793795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 145/297] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:36 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:36.806770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.807845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.817469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.818272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.818936 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.819829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.820483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.821060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.030609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:37.032495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:37.043964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.048993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.050200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.050997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.052450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.053534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.054384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.067179 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.071949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.076245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a8845009-4383-4840-833b-21df2eef0642 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.286929 Aug 29 23:54:37.105619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 153/298] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:36 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:37.300291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.309492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0795e12d-8932-4a24-ae0d-41c0f4a3e5cc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.287550 Aug 29 23:54:37.309492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 146/299] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:37 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:37.502899 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:37.503821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:37.513725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.513725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.513725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.515111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.515111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.515111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.635714 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945733108", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b40027-b034-467e-a623-8d465afe9154"}], "security_groups": [{"name": "tempest-securitygroup--346695673"}], "key_name": "tempest-keypair-1666743028", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:37.844661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.858793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-74fda9e9-d887-49f8-a740-48c5b5481eda tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1508 microversion: 2.1 time: 0.359806 Aug 29 23:54:37.889671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 154/300] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:37 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:37.919157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:37.920472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:37.929339 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] validate_networks() for [('60b40027-b034-467e-a623-8d465afe9154', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:37.945815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.946409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.946911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.949500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.949899 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.950458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.082216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.111716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-607c4781-ca4d-4c53-b892-6fedce28fc57 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1218 microversion: 2.1 time: 0.212375 Aug 29 23:54:38.112539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 155/301] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:37 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:38.139683 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.140741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.151700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.153025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.153897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.157949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.157949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.157949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.493814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.507271 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.508864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.524501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d2e29081-7453-4a73-93c3-1f489fe599cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.377953 Aug 29 23:54:38.524501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 156/302] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:38.524501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.524501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.542406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.542406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.542406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.543737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.548377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.548902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.875887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.927072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-babe174d-20a0-47df-b3fc-a367d782cca8 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.408740 Aug 29 23:54:38.940212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 157/303] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:38.948147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.951164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.966228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.966973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.967692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.968774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.969457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.970150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.200503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:39.201517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:39.202138 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:39.202709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:39.203275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:39.220751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.222059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.224248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.225355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.227320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.231811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.280834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:39.285881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:39.293175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:39.330134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.336122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:39.339115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-15fd74b7-3343-47b3-a19a-fa25cb2cb5df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1514 microversion: 2.1 time: 0.408292 Aug 29 23:54:39.342442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 158/304] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1514 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:39.344769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:39.348103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643bb5c5-0c90-4aa6-b32b-6082a8e40e3d", "tag": "fc16ae60-96b4-45ec-ac85-c7b2056ef931"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:39.368344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.368812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.369237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.397177 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] Creating event network-changed:fc16ae60-96b4-45ec-ac85-c7b2056ef931 for instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d on hv-cinder-85504 Aug 29 23:54:39.413379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-923c6e58-1fc7-4e3d-a192-525abd1a3cdb req-f473b3a1-76b8-42a2-a0a5-ad7aa296f8c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066528 Aug 29 23:54:39.414519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 159/305] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:39.421751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:39.422743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:39.430665 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.431482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.432086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.433207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.433927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.434525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.559131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.569798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d2104c67-d238-4a29-8a09-fb5c6f053272 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1266 microversion: 2.1 time: 0.153147 Aug 29 23:54:39.570853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 160/306] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:39 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:39.588323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:39.592285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:39.609260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.610288 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.610939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.612441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.613999 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.614618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.675747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10e27561-3780-4c13-9618-3e7195be0944 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.042267 Aug 29 23:54:39.676754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 147/307] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:54:39.691280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6be66eea-358b-4588-933f-c0052cb7e66f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:39.692360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6be66eea-358b-4588-933f-c0052cb7e66f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:39.900579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6be66eea-358b-4588-933f-c0052cb7e66f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.915846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6be66eea-358b-4588-933f-c0052cb7e66f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1241 microversion: 2.1 time: 0.229529 Aug 29 23:54:39.921856 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 148/308] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:39 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1241 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:39.967481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:39.968499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:39.989322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.992704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.002690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.002690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.002690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.002690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.003037 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.003143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.012742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.015902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-75d1fabd-4c58-4817-860a-c063bd536a74 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.442366 Aug 29 23:54:40.016548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 161/309] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:39 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:40.247173 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.265383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bfc7a68c-2949-4d48-a4ff-9b2d24cc5b84 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.302573 Aug 29 23:54:40.267804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 149/310] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:39 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:40.593708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:40.594193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:40.611720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.612435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.612880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.613711 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.614164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.614587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.731717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.741554 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-72f3436b-12be-4f0a-8bc8-b49f2f78116d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1266 microversion: 2.1 time: 0.151977 Aug 29 23:54:40.742457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 162/311] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:40 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:40.944883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-771cacad-8ac6-49ae-82af-ac71ff6bff37 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:40.945487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-771cacad-8ac6-49ae-82af-ac71ff6bff37 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.021486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-771cacad-8ac6-49ae-82af-ac71ff6bff37 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.029586 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-771cacad-8ac6-49ae-82af-ac71ff6bff37 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1241 microversion: 2.1 time: 0.090043 Aug 29 23:54:41.030154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 150/312] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:40 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:41.048639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.049662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.056900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.057474 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.058811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.060009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.061086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.061726 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.250731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.274053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.275501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.277648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c4ec3ad2-1468-42df-89da-ff5f018bb7fc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.241846 Aug 29 23:54:41.278515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 163/313] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:41.289735 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.294407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.300712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.301257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.301692 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.302376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.303130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.303453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.544999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.560453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-76cd2eb1-1d6e-4f40-9397-e4daed82cafa tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.273313 Aug 29 23:54:41.564208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 151/314] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:41.611848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:41.620165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.621270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.622041 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.669426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2a6a3a6b-1fbb-431e-ab31-109f7218bf27 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: .version_select at 0x7fd5a6a19e50>, body: {"keypair": {"name": "tempest-keypair-1425097786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsoMaHUtEFBIqDI4Kd0654hP7kTcpAlrtHbRJtY7BoNMG5WeR/rmFokUYvdNwuU1YZIOO6HPxSWzjMGXHNsjOc8ZhcgseqS4RdCF6AibNA8+zxXv3VtzmMQ09pIT0aoTg=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:41.691175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2a6a3a6b-1fbb-431e-ab31-109f7218bf27 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:41.695634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2a6a3a6b-1fbb-431e-ab31-109f7218bf27 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for user 57998546e6a64d42ba3ded9f3267e6af and project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:41.729324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Going to try to stop instance {{(pid=127669) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 23:54:41.834343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2a6a3a6b-1fbb-431e-ab31-109f7218bf27 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169506 Aug 29 23:54:41.835317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 152/315] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:54:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:41.846939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.847552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.860291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.860747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.861186 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.861897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.862354 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.862764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.955729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d61664bc-909d-4885-b035-6058e8ec6f7e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action" status: 202 len: 0 microversion: 2.1 time: 0.347164 Aug 29 23:54:41.958573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.961173 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 164/316] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:41 2022] POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:54:41.967225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-77ce9e67-4c66-47c7-bd75-84bb767806b4 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1274 microversion: 2.1 time: 0.130482 Aug 29 23:54:41.969622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 153/317] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:41.985191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.985897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.999336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.001088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.008499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.008499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.008499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.008499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.052377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:42.052988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:42.091851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.091851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.091851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.092292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.092511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.095715 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.287867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.302135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5f4f9a1a-facd-4b7e-89cc-ad2ea15eb6d2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1245 microversion: 2.1 time: 0.253792 Aug 29 23:54:42.307090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 154/318] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:42 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1245 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:42.320084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:42.324749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:42.329167 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.336826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.337368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.338105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.338827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.339349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.340473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0bb05c44-b11c-436f-9ffe-70627e3c52f9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.378648 Aug 29 23:54:42.340609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.343762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 165/319] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:42.576740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.582409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:42.583345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:42.593266 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.597411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.598191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.601322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9b3f1a30-8e1a-4289-a94b-42a7fe33cc65 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.292046 Aug 29 23:54:42.604409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.604409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.604409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.604409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.604811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.605502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 155/320] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:42 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:42.831058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.833903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:42.844424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5f150936-78b1-428c-a898-2655743ccc85 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.264500 Aug 29 23:54:42.846102 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 166/321] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:42 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:42.993511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:42.994163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.002652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.003059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.003702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.004625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.005083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.005503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.131428 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.145280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-463ef241-ed36-4f70-b77d-601d1445b434 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1284 microversion: 2.1 time: 0.155850 Aug 29 23:54:43.160591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 156/322] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:42 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:43.328646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.329056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.339689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.340664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.341330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.343392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.344417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.345799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.364792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.365498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.373212 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.375342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.375942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.376821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.377417 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.377983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.424913 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.443148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9966d89a-7f20-47e3-8729-17c1bde33088 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1237 microversion: 2.1 time: 0.120086 Aug 29 23:54:43.444358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 167/323] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:43.631192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.632094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.634360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.642437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-187fccab-49b7-47b9-8d17-cde66a5661a3 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.282031 Aug 29 23:54:43.642976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.643733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.644537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.647354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.649377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.652300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.656653 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 157/324] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:43.827190 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.841697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.845565 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.847412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7f6ecb35-aac8-4746-8523-16b12419b78e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.223603 Aug 29 23:54:43.848239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 168/325] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:43.875590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.875590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.884071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.884987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.885787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.887128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.888156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.888990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.063873 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.072513 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ea0c343-6837-401c-a19c-f48ca9f02464 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.210000 Aug 29 23:54:44.073024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 158/326] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:44.190237 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:44.192335 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.224872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.225890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.226693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.228538 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.234590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.235664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.335154 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.351817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-72e842c5-cce9-4933-b3cd-41f4a297be4e tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1284 microversion: 2.1 time: 0.180539 Aug 29 23:54:44.353374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 169/327] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:44 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:44.472275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:44.477000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.500013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.505591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.506375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.507741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.508618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.509394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.666988 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:44.667811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.687713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.687713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.687713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.687713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.688603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.688603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.703883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.752776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d6bed016-7d14-4bda-ab1c-65fa131de416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1237 microversion: 2.1 time: 0.287248 Aug 29 23:54:44.768161 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 159/328] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:44 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1237 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:44.928355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:44.935752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.958072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.962967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.962967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.963925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.965913 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.966998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.057063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.075903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8a876af0-d5e3-4dc8-a509-6be5fc533b23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.411631 Aug 29 23:54:45.080893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 170/329] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:44 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:45.117142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:45.118894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:45.141949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.142896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.143750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.144864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.145703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.146431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.628705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.677674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.687704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.702495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c25f1d90-4436-4fea-92cb-cd4f4aeb4f62 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.791655 Aug 29 23:54:45.704223 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 160/330] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:44 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:45.730392 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:45.735006 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:45.768342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.773285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.776437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.783030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.799020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.800238 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.832506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.869809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7ab024c9-5557-46ed-be33-c4103a177c39 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.756796 Aug 29 23:54:45.871549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 171/331] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:45 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:45.895855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:45.903875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:45.911589 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.912271 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.917060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.923081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.924689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.925415 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.926243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.934423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dc7521d9-6d85-4f9f-bc5b-a6c4153fc889 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1272 microversion: 2.1 time: 0.223474 Aug 29 23:54:45.950036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 161/332] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:45 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:46.117355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:46.118159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:46.146372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.149787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.150597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.152929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.155591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.157677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.172018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.196740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4cf7a907-1a9a-4458-ae87-3de80a45d237 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1293 microversion: 2.1 time: 0.315602 Aug 29 23:54:46.236080 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 172/333] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:45 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1293 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:46.532095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.562317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86a1eff9-3181-489d-9873-50948d08d4b6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.449816 Aug 29 23:54:46.577723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 162/334] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:46 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:46.765161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:46.766111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:46.773323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:46.774309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=14 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:46.777093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.777845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.778482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.779447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.780112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.780952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.897445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:46.898260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:46.913015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.913514 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.913951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.914661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.923802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.924387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.968747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.983596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.991207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.991207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e8e1ab83-6c38-4728-b71e-8b992d27734d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.227387 Aug 29 23:54:46.991207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 173/335] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:46 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:47.019536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:47.021854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:47.041701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.046417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.048296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.049752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.051750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.052635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.657997 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:47.666563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6d055024-3259-41ab-a6fd-c65b5b5a930c tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1272 microversion: 2.1 time: 0.678312 Aug 29 23:54:47.667567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 174/336] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:46 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1272 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:47.693672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:47.694305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:47.724087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.729754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.730112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.731447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.732318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.732930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.785835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:47.824427 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8104c49f-6e2b-49d7-b06c-7dc45081f4d3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.927385 Aug 29 23:54:47.843374 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 163/337] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:46 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:47.883908 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:47.893273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:47.912400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.913454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.916823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.920791 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.922632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.923901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.943228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:47.962406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e40445e6-8979-4c97-b1d7-ae83bcdefff8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1301 microversion: 2.1 time: 0.276176 Aug 29 23:54:47.967694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 175/338] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:47 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1301 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:47.997963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:48.027023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:48.038509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:48.073048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.074397 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.075375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.083568 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.092802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.093922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.424317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.483263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-65937608-4630-480a-be6e-391d7826736d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.632792 Aug 29 23:54:48.485797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 164/339] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:47 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:48.501997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643bb5c5-0c90-4aa6-b32b-6082a8e40e3d", "name": "network-vif-plugged", "status": "completed", "tag": "fc16ae60-96b4-45ec-ac85-c7b2056ef931"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:48.531886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.546564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.547639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.594475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] Creating event network-vif-plugged:fc16ae60-96b4-45ec-ac85-c7b2056ef931 for instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d on hv-cinder-85504 Aug 29 23:54:48.612797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-8525cfb3-22f9-41f9-93b8-2cc1e4c1342c req-ed376128-9a93-43b1-98cf-b4bd8454af53 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122660 Aug 29 23:54:48.614633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 165/340] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:48.673875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.713904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:48.720219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:48.733100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.754358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.772957 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.773451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e6c6e212-66f2-462b-932e-c62ee7fefacf tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.742603 Aug 29 23:54:48.773640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.773640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.773945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 176/341] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:48 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:48.774107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.774107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.774107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.871949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:48.876117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:48.897126 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.898966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.900709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.902911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.904709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.906221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.012637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.028473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d00c9821-2f64-4c9e-adc6-9526e39a7927 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.337289 Aug 29 23:54:49.030270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 166/342] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:48 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:49.061222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:49.062981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:49.092818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.093765 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.094707 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.095930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.096729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.097457 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.256804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:49.453059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.468157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4bd32102-affb-43be-9ee4-66649ff6e9be tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1299 microversion: 2.1 time: 0.436785 Aug 29 23:54:49.473336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 167/343] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:49 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1299 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:49.484338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.495610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1335452850", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e198d273-347a-4fa0-82d5-22e40c3600ea"}], "security_groups": [{"name": "tempest-securitygroup--650376345"}], "key_name": "tempest-keypair-1425097786", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:49.507616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4da3a61b-d89b-4546-8b8f-d033baeb23de tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.645643 Aug 29 23:54:49.513011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 177/344] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:48 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:49.535579 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:49.536401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:49.546419 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.547376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.548056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.549883 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.550850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.551469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.002409 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] validate_networks() for [('e198d273-347a-4fa0-82d5-22e40c3600ea', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:50.292598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.305408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-035c44ba-d5ef-4f71-bdea-2accda409c02 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.775944 Aug 29 23:54:50.308022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 178/345] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:49 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:50.316011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:50.320127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:50.335357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.336246 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.337009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.338091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.343398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.344403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.757649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.773185 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.779568 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.794090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fe89bb74-cc71-4eca-8592-afd8a9a266ba tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.484509 Aug 29 23:54:50.795181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 179/346] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:50 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:50.816146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:50.817300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:50.832100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.833399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.838139 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.839574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.841129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.841681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.978439 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:50.978885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:50.979608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:50.980035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:50.980833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:50.993350 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.994345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.995387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.997931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.999795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.000720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.046004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:51.062333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Getting quotas for user 57998546e6a64d42ba3ded9f3267e6af and project dc817de5d4ef4812a2fee6ebe0895889. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:51.082315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:51.085969 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:51.179351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:51.187705 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f62fbfd3-9079-4ad7-a2f6-f63a1dd9abd1 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.391197 Aug 29 23:54:51.188334 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 180/347] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:50 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:51.193324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:51.194176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:51.201283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.201788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.202221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.203020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.203481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.203905 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.299311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:51.307235 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bb02f83f-b2f8-40f1-8630-42a94df100fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1299 microversion: 2.1 time: 0.117727 Aug 29 23:54:51.308398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 181/348] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:51 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:51.319112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:51.319872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:51.328618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.329134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.329568 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.330312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.330798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.331222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.499205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:51.510157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ebc19713-0e16-41b1-a8f8-7d2dc94aeeb3 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1319 microversion: 2.1 time: 0.200672 Aug 29 23:54:51.512083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 182/349] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:51 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:51.518552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:51.519170 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:51.525742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.526255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.527115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.527946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.528462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.528894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.554850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:51.884308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-48b20301-9bca-467e-8b88-b97539165d7d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.390250 Aug 29 23:54:51.894858 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 168/350] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:54:51.921402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4", "tag": "20416f60-1b8c-4fa9-8b4d-d8c3890c5182"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:51.946144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.949391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.950437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.991460 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] Creating event network-changed:20416f60-1b8c-4fa9-8b4d-d8c3890c5182 for instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 on hv-cinder-85504 Aug 29 23:54:52.016529 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-128a3103-448d-42df-84c5-12cadcddb318 req-20d23c84-78d1-4ecf-96af-457fa33074d3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118999 Aug 29 23:54:52.017296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 169/351] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:52.032159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:52.033169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.048744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.050045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.053128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.054379 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.059136 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.059932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.130603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.234547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fc2df90f-4984-49df-906d-c7afe53ea7af tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.719200 Aug 29 23:54:52.235785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 183/352] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:51 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:52.246229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-66a81b1d-28a4-47c0-b4c4-9b88e06ed8ae tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:52.247367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-66a81b1d-28a4-47c0-b4c4-9b88e06ed8ae tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.497377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-66a81b1d-28a4-47c0-b4c4-9b88e06ed8ae tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.512859 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-66a81b1d-28a4-47c0-b4c4-9b88e06ed8ae tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1246 microversion: 2.1 time: 0.274110 Aug 29 23:54:52.519611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 184/353] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:52 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1246 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:52.521866 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:52.522881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.535123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.536024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.536867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.551590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.555228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.556768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.764951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.779452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.786594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.789630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-310fb216-335d-4c29-98db-d311a6dec65b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.769557 Aug 29 23:54:52.792220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 170/354] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:52 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:52.798986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:52.811412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.830058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.831659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.832251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.833347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.834026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.834536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.103624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:53.116209 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b0e18ea4-53e9-4bd8-8570-6ae25b5fcea6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.599385 Aug 29 23:54:53.117120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 185/355] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:52 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:53.148977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.149673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.183491 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.184876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.185512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.189176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.189861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.190444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.295181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:53.310009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-93332630-06c7-494b-8574-11962ecfa017 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.514171 Aug 29 23:54:53.311978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 171/356] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:52 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:53.337041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.358304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.397123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.398298 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.399331 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.401277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.404470 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.411744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.634902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:53.660486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b9b6ed71-e9bb-4c9d-9f12-32259773083f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1508 microversion: 2.1 time: 0.524540 Aug 29 23:54:53.665792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 186/357] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:53.674813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-06843506-d6aa-4cbc-9477-39a1cbe4f6d7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.675571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-06843506-d6aa-4cbc-9477-39a1cbe4f6d7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.803214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-06843506-d6aa-4cbc-9477-39a1cbe4f6d7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:53.814973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:53.817452 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-06843506-d6aa-4cbc-9477-39a1cbe4f6d7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1246 microversion: 2.1 time: 0.153267 Aug 29 23:54:53.818082 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 187/358] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1246 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:53.824226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.825056 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.832805 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.833399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.833853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.835052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.835496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.835977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.892225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5061cde2-2220-40cc-b8bc-78d4c8c1a206 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.577856 Aug 29 23:54:53.922043 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 172/359] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:54.155363 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:54.156833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:54.170558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.175594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.196234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.197093 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.197589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.198577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.210955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.228752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.231567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.236337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4f0c9da1-7cc3-456a-883c-0c6a49c05558 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.417057 Aug 29 23:54:54.262116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 188/360] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:54.275042 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9887a44d-5fe2-4e65-aab4-5123e84fd9b6", "tag": "f86aed97-d345-4c61-b637-b4d4771086c3"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:54.315130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.317074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.317074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.351081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] Creating event network-changed:f86aed97-d345-4c61-b637-b4d4771086c3 for instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 on hv-cinder-85504 Aug 29 23:54:54.361117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-e538344b-acfb-40a0-9000-ed53b6b1c617 req-3f102f5a-fc69-421b-891b-e287210da160 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089260 Aug 29 23:54:54.363886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 189/361] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:54.378071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:54.380394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:54.394070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.395349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.396618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.398635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.400043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.401035 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.695055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.706906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a5238d4d-48a0-49b7-b9f2-253f010a4134 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.558657 Aug 29 23:54:54.707760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 173/362] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:54 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:54.782054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.803152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-baf56cca-09eb-490e-9f70-20093854859b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.436549 Aug 29 23:54:54.812259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 190/363] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:54 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:54.864835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:54.866547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:54.894724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.900272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.901374 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.906421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.907520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.908346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.945958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:54.947018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:54.964496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.965418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.965979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.966882 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.967788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.968370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.016759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.028725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1662d3e7-0320-498d-a791-80c5f24a8140 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1242 microversion: 2.1 time: 0.168244 Aug 29 23:54:55.044803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 174/364] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:54 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:55.258841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.272139 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:55.273222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:55.308518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-aaea4d90-8276-4ad5-9399-68a567871a87 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1722 microversion: 2.1 time: 0.362507 Aug 29 23:54:55.308518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 191/365] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:54 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:55.349448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.352081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.357414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.358992 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.360117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.361195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.738309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:55.739699 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:55.773676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.777371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.778336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.784539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.785743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.788384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.939082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.983781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.998319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:56.007116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-be418e84-244e-48e0-8572-ea6b87271111 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.735940 Aug 29 23:54:56.013486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 175/366] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:55 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:56.043266 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:56.052352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:56.065529 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.066711 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.067673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.069286 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.070844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.071843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.510014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:56.548618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a18bf113-f997-4c6f-acb5-6566f2a416c8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.821919 Aug 29 23:54:56.557008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 192/367] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:55 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:56.578224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:56.579232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:56.620245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.626289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.628414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.631397 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.633699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:56.638294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.639243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.655859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a5fae9dd-bffc-4876-8c73-0ad5788c1e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.640017 Aug 29 23:54:56.656604 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 176/368] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:56 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:56.670868 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:56.671608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:56.685047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.685546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.686674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.687433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:56.688090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:56.688560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:56.806901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:56.821481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-72321779-174b-4b8a-8233-32aee578095b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1298 microversion: 2.1 time: 0.262146 Aug 29 23:54:56.822381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 193/369] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:56 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:57.048720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:57.049372 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.071616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.072121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.072612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.073406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.073879 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.074320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.102425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.125230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-df811810-993f-4871-89f0-6f110b27a0bb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1699 microversion: 2.1 time: 0.467456 Aug 29 23:54:57.136254 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 177/370] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:56 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1699 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:57.173922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:57.203885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.209248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.210503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.349887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.361063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.364204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.365450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-22837c41-3de9-481e-8801-08d2a94edfed tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.322052 Aug 29 23:54:57.366422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 194/371] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:57 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:57.399335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Going to try to start instance {{(pid=127670) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 23:54:57.612534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:57.612534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.643098 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.647501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.650264 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.654602 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.656533 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.660671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.714061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d7e8a6e2-f594-49d0-a63a-45d36b4dddd7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action" status: 202 len: 0 microversion: 2.1 time: 0.557419 Aug 29 23:54:57.725318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 178/372] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:57 2022] POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:54:57.743833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:57.748581 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.755779 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:57.766316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.767438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.769540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.780466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.784698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.785727 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.476742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:58.489296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-41ba8976-6a8d-43cf-8575-9232c53d3ebc tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.890262 Aug 29 23:54:58.513398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 195/373] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:57 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:58.524727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:58.528115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:58.532576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:58.543094 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.553123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.553990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.558230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.558230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.558230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.565058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c32412d5-d6f2-4fe5-8a1e-f660c267d6d5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.830186 Aug 29 23:54:58.567541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 179/374] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:57 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:58.589110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:58.591700 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:58.614273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.618545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.622618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.626696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.628083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.634909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.827353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:58.838970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-245d1c20-5bf5-47ea-b15a-55f78a641e06 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1316 microversion: 2.1 time: 0.267495 Aug 29 23:54:58.839865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 180/375] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:58 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:58.860120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:58.879742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:58.901855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.904505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.904505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.904505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.904505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.905187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:59.045546 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.078307 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e3e8ec90-2f55-41e6-9cff-5be5d906d94c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1708 microversion: 2.1 time: 0.562158 Aug 29 23:54:59.083074 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 196/376] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:58 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1708 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:59.100198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4", "name": "network-vif-plugged", "status": "completed", "tag": "20416f60-1b8c-4fa9-8b4d-d8c3890c5182"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:59.131893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:59.132783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:59.133530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:59.153681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] Creating event network-vif-plugged:20416f60-1b8c-4fa9-8b4d-d8c3890c5182 for instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 on hv-cinder-85504 Aug 29 23:54:59.162563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-ba748cdb-1e77-4499-aa8a-3ee9cfb06bb8 req-e09cb4a4-a39b-44d2-b57b-1044f72e831d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076360 Aug 29 23:54:59.164583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 197/377] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:59.280390 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.328591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:59.328591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.328591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.329280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-77b1e99b-da47-4b58-959f-fee80baa1fd9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.455184 Aug 29 23:54:59.329280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 181/378] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:58 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:59.533191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:59.535260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:59.561998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:59.562811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:59.563744 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:59.565429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:59.566412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:59.567299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:59.595839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:59.596880 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:59.618318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:59.621129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:59.625206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:59.629708 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:59.631124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:59.632812 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.181619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.194907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7193a261-1d02-41cc-858f-7170e9eb50c6 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.678715 Aug 29 23:55:00.196051 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 198/379] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:59 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:00.211333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:00.212748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:00.217467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:00.245422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.245957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.246817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.248406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.249525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.251159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.254844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.268318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bf17dcd1-4f6d-49ce-88e9-cbe7dc6cb104 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.677697 Aug 29 23:55:00.269219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 182/380] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:59 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:00.280955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:00.282818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:00.290720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.292202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.292848 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.294483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.295180 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.295780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.389668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.400228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6f4738b9-728a-4fb5-92c1-a6ae681d9a7f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1304 microversion: 2.1 time: 0.202093 Aug 29 23:55:00.400228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 199/381] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:00 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:00.414233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:00.415515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:00.428551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.429601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.430532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.431612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.432769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.433278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.646814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.663806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b88579b0-762e-4434-87b6-504ef503df76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1708 microversion: 2.1 time: 0.390019 Aug 29 23:55:00.665992 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 183/382] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:00 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1708 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:00.711755 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.742156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.744408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.749403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3093bdbc-9b3e-403b-b3d5-09885b3a3dde tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.345816 Aug 29 23:55:00.761115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 200/383] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:00 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:01.239819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.244998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.261954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:01.279403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=28 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:01.303347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.303987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.310886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.318128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.320205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.321734 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.327769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.330768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.331284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.331581 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.332076 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.332822 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.335143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.337112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.764717 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:01.774748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:01.779003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10e1141f-db62-4661-a150-31e1752350f7 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.563128 Aug 29 23:55:01.792402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 184/384] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:01.799448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f64908c6-9865-4573-a076-e541d3a0e7fd tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.499480 Aug 29 23:55:01.801191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 201/385] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:01.809492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.813134 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.826181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.827741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.837907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.838461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.839133 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.840246 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.840929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.841744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.854096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.864290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.864290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.864290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.865778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.866227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.109776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.130694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-57365151-f2a4-44e5-84f4-d226cc5363aa tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.335496 Aug 29 23:55:02.144842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 185/386] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:02.150090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:02.151597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:02.158960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.159840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.160673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.162352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.163089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.163738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.269334 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.308155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6095f94e-cbbc-422c-8f17-26ee33ec9222 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1708 microversion: 2.1 time: 0.498351 Aug 29 23:55:02.309429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 202/387] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1708 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:02.484219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.494645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.496203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.497454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d5a9e24e-59eb-40d6-870b-cec892dafdaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1738 microversion: 2.20 time: 0.351458 Aug 29 23:55:02.498268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 186/388] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:02 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:02.806225 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:02.807678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:02.818483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.819418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.820286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.821610 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.823376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.824531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.827060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:02.828314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:02.839333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.840121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.840739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.841590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:02.842060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:02.843120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:02.863960 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:03.450071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.461316 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.466386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-66a3de1e-ffbe-40b8-be29-644012a05bda tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.644794 Aug 29 23:55:03.467961 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 187/389] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:02 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:03.477139 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:03.483136 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-20e26162-6999-4538-857f-c21f6d32f667 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1314 microversion: 2.1 time: 0.681316 Aug 29 23:55:03.497950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 203/390] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:02 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:03.506877 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.508234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.511014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.527308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:03.528666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:03.549981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] Creating event network-changed:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:55:03.556496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-6363c756-71da-495f-b683-dc6a172709df req-68c1ba46-741d-4420-9a59-ecbcfa4b553d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086524 Aug 29 23:55:03.557820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 188/391] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:03.560400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.560400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.566777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.569120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.570267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.571885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.576990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:03.578074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:03.586759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.587473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.588068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.589584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.590261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.593103 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.813548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:03.903462 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.910889 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.919719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0b8f0dc7-7504-45ce-bfbc-68aa14e3cfe0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1712 microversion: 2.1 time: 0.349663 Aug 29 23:55:03.920568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 189/392] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:03 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1712 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:03.920758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ff09327a-f935-4872-bead-e49eb012840f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.421897 Aug 29 23:55:03.921286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 204/393] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:03 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:03.930352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:03.931475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:03.944405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.945374 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.947372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.953104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.953104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.953104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.176127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:04.190092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:04.193694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:04.196428 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7075063e-56e2-4410-8793-de46ce41354f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.273226 Aug 29 23:55:04.197764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 190/394] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:03 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:04.527503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:04.528473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:04.529224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:04.530594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:04.541133 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.542651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.543277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.545380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.546090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.546720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.551903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.556272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.556272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.556992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.558570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.559395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.055237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.070916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6af4a736-18c6-4224-92f3-b641154f5b60 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1498 microversion: 2.1 time: 0.550629 Aug 29 23:55:05.073231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 191/395] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:04 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1498 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:05.079514 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:05.081181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:05.093372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:05.094925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:05.096077 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.097866 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:05.099166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:05.100260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.205395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.219299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ffb824e2-5d67-46d3-adee-6b2d7bd81d6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.715810 Aug 29 23:55:05.222545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 205/396] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:04 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:05.228667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9887a44d-5fe2-4e65-aab4-5123e84fd9b6", "name": "network-vif-plugged", "status": "completed", "tag": "f86aed97-d345-4c61-b637-b4d4771086c3"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:05.241948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:05.242850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:05.243678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.290153 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] Creating event network-vif-plugged:f86aed97-d345-4c61-b637-b4d4771086c3 for instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 on hv-cinder-85504 Aug 29 23:55:05.299635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-ad9e953c-0e64-4d95-9760-4d6efbd686c7 req-78abe027-954f-4011-88ce-6d11f6e76936 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075439 Aug 29 23:55:05.300916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 206/397] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:05.308408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:05.309400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:05.333840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:05.333840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:05.333840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.345684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:05.346504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:05.349375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.623361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.640251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-66be0688-2762-4680-832c-e36579f7ab47 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.565037 Aug 29 23:55:05.641829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 192/398] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:05 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:05.702749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.726723 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.730722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.734319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8e3dacd2-408f-47c0-810d-f8111fe5a870 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.431379 Aug 29 23:55:05.735732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 207/399] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:05 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:06.263099 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.264125 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.276757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.277888 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.282284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.283157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.284126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.285615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.285846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.286357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.286804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.287230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.288105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.288434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.289058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.289811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.342215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:55:06.486430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.501162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fec23622-cd2b-40c6-bdf8-ad8eccb4bd6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.244435 Aug 29 23:55:06.503270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 193/400] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:06.669075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.670552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.693177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.698087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.698087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.698087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.698087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.699775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.819114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8c5b4dad-b5fd-4c4b-9e26-175f0b9db052 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "DELETE /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 204 len: 0 microversion: 2.1 time: 0.546060 Aug 29 23:55:06.827000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 208/401] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:55:06 2022] DELETE /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:55:06.840862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.842902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.861557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.862929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.863841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.865066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.865735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.866398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.129202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.142561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-825231e7-31ea-4802-9346-6b95a24096d5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.480733 Aug 29 23:55:07.158407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 194/402] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:07.164269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.164907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.172421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.172809 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.173245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.173967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.174425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.174854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.197623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.211876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.214157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.215353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1a3a252e-fb1f-4ab0-ba1d-486ae3cd84a7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.384482 Aug 29 23:55:07.215944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 209/403] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:07.336405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:07.348402 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.349199 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.349832 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.353599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.363928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e38fb135-9242-414d-8095-82b379d03a3a tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1504 microversion: 2.1 time: 0.203811 Aug 29 23:55:07.364257 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] Creating event network-vif-unplugged:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:55:07.364921 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 195/404] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:07 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:07.370447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b81b1224-275e-4276-94da-2f464a2fc0d8 req-1666b82d-0451-4690-b1f7-06103e09ba55 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037979 Aug 29 23:55:07.371310 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 210/405] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:07.527066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.528158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.535948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.536561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.537064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.537925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.538571 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.539099 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.733792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:07.742143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ab58c293-e40a-48d0-bc36-4ea8a78697e3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.221078 Aug 29 23:55:07.742844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 196/406] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:07 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:08.166955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:08.167912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:08.174835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.175476 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.175967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.176738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.177208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.177670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.256705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:08.257740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:08.270805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.271678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.272475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.273792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.274667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.276475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.663677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.668321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.683302 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.687520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.693044 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-90bf0d76-2bb7-49d1-933e-c3ed4b018e81 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.440731 Aug 29 23:55:08.696370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 197/407] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:08 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:08.709973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:08.711323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:08.716286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-70b07884-923f-409b-98f6-81e6af773aba tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.553282 Aug 29 23:55:08.724941 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.725803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.726570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.728373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.729157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.729983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.733079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 211/408] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:08 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:08.778423 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:08.779350 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:08.788989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.789495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.790163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.790913 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.792805 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.793455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.034585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.036357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.046209 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3fd2927a-c80c-40a7-89cc-eb96a1ef7772 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.275035 Aug 29 23:55:09.046912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 212/409] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:08 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:09.050478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b60e3859-9e64-4cab-85a1-c735d4ba20f2 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1504 microversion: 2.1 time: 0.351842 Aug 29 23:55:09.051445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 198/410] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:08 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:09.717854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:09.718519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:09.725583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.726109 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.729409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.729409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.729409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.729409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.755320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:09.756019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:09.763461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.763953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.764412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.765111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.765564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.765983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.769131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:09.926229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.939101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.941084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.942542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-921c1653-4129-4f7d-af85-ff8e26613632 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.229505 Aug 29 23:55:09.943282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 213/411] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:09 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:09.958945 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.970217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f5c5adf8-88c4-4436-a8f8-0be454ab4e62 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.219098 Aug 29 23:55:09.970874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 199/412] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:09 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:10.070474 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:10.071601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:10.078018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:10.079349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:10.083592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.084426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.086077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.087359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.088896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.089854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.091846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.097823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.097823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.097823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.097823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.098420 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.347509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.362837 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bfc1bb44-4a0c-4ebd-97b9-5cd771113f31 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.298606 Aug 29 23:55:10.364010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 214/413] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:10 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:10.370049 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.384070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b1c093e6-af2c-426d-901d-c67d9863f7f9 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1504 microversion: 2.1 time: 0.314065 Aug 29 23:55:10.386001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 200/414] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:10 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:10.583788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "name": "network-vif-plugged", "status": "completed", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:10.596468 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.596954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.597384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.610794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] Creating event network-vif-plugged:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:55:10.616526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b95a163d-f220-499a-af8b-e7fd0abb3797 req-072a81fb-b4c2-43dc-be70-755252b0a23c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036688 Aug 29 23:55:10.617173 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 215/415] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:10.969273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:10.970155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:10.978483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.979680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.980136 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.980933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.981398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.981826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.000410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:11.008475 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:11.014321 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.016323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.017305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.019000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.020071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.021094 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.264052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.273530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.274980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.277578 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8a1c8345-0029-4dc0-8099-bb71c0a1ad11 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1720 microversion: 2.20 time: 0.313179 Aug 29 23:55:11.278692 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 201/416] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:10 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:11.375318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.387321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:11.388104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:11.394479 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bb7456b8-7c77-4c14-9952-edba3e49cbf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.404971 Aug 29 23:55:11.396341 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 216/417] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:10 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:11.398516 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.401239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.402231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.403968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.405729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.407696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.426528 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:11.427611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:11.454263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.455112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.456061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.457058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.457961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.458567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.657815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.679703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-897c3ea2-cb5f-423f-8384-a5d67331cf5d tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1462 microversion: 2.1 time: 0.266239 Aug 29 23:55:11.688138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 217/418] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:11 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1462 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:11.695639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4", "name": "network-vif-deleted", "tag": "20416f60-1b8c-4fa9-8b4d-d8c3890c5182"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:11.710377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.710927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.711405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.735984 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] Creating event network-vif-deleted:20416f60-1b8c-4fa9-8b4d-d8c3890c5182 for instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 on hv-cinder-85504 Aug 29 23:55:11.741762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b6385f46-a254-4dd5-8bfd-62ebf208ac9f req-afd97802-1aed-4cb8-9021-f0a0674f0277 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051724 Aug 29 23:55:11.742560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 218/419] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:11.776068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.799425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6c963a92-88da-44c9-b7a2-09564d39e614 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1366 microversion: 2.1 time: 0.416927 Aug 29 23:55:11.801305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 202/420] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:11 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:12.303459 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.305066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.312693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.313187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.313622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.314371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.314828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.315249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.425659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.431846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.464084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.464084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.464084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.464084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.464531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.464531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.572783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.583366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.586214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.589029 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-91f7b71a-ecbe-47b7-9be0-43d33d7e9eab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1723 microversion: 2.20 time: 0.290179 Aug 29 23:55:12.589893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 219/421] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:12.613643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4dc5ca2-0255-49d2-9e8c-7968f2e71208"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:12.616213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.624921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.625719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.626163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.626888 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.627540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.627986 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.725102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.734384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-985c2c22-396e-4006-b3c2-2e7046b99feb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.318387 Aug 29 23:55:12.735437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 203/422] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:12.745196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.745935 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.752610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.753187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.753849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.754622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.755283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.755769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.758131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:12.794105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.794592 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.795027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.795524 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lazy-loading 'fault' on Instance uuid dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:12.863297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.872491 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5fe7e672-9822-4a40-8a23-d2a83cf777e8 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1304 microversion: 2.1 time: 0.135207 Aug 29 23:55:12.873283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 204/423] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:12.883918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.885796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.899949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.901611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.902479 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.904334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.905476 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.906280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.128967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.138267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-010c311d-4ca0-4e9d-8661-92e804c8e0cb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1557 microversion: 2.1 time: 0.263510 Aug 29 23:55:13.138871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 205/424] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:13.160677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:13.161179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:13.170013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.170804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.171533 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.173303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.174137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.174719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.269274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0130a206-6a40-4c74-bec8-24d70e699536 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112912 Aug 29 23:55:13.270013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 206/425] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:55:13 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:13.552203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22944258-7c8e-4aca-a756-13afa7ff0ad8", "device": "/dev/sdb"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:13.557423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:13.588783 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.589657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.591560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.592982 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.593632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.594094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.171028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-12a04190-37c1-4a2f-8dad-c5b7282dd9d5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.561672 Aug 29 23:55:14.182059 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 220/426] 10.222.0.90 () {62 vars in 1364 bytes} [Mon Aug 29 23:55:12 2022] POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments => generated 188 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:55:14.191196 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:14.191953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.207002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.208788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.213584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.213584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.213584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.213584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.521602 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.535040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a3f87763-15e7-43bc-b0b7-395f04e64436 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1371 microversion: 2.1 time: 0.351251 Aug 29 23:55:14.536018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 221/427] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:14 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:14.553816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:14.554770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.565506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.566314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.566933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.569161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.569885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.570505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.612584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.613764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.614420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.615067 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lazy-loading 'fault' on Instance uuid dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:14.699320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f2bdc1ced843d7afd419e7e5b7d4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9642272967c46b188cf1bced9ea6ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.707674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b0ab871f-d1f8-4afd-936c-45f254d58f20 tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 200 len: 1304 microversion: 2.1 time: 0.170020 Aug 29 23:55:14.708436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 222/428] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:14 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:14.714165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:14.714857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.721300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.721873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.722401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.723203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.723751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.724200 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.794198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127669) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 23:55:15.156241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e31d25aa-26b9-4686-8d32-f4dbe110256f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/action" status: 202 len: 0 microversion: 2.20 time: 0.446406 Aug 29 23:55:15.170925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 223/429] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 23:55:14 2022] POST /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:55:15.185149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9887a44d-5fe2-4e65-aab4-5123e84fd9b6", "tag": "f86aed97-d345-4c61-b637-b4d4771086c3"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:15.208691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.209736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.210633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.239809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] Creating event network-changed:f86aed97-d345-4c61-b637-b4d4771086c3 for instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 on hv-cinder-85504 Aug 29 23:55:15.251602 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-6c5f0717-5798-492e-85e0-241c0fe58e92 req-bbdfe139-1a29-4579-9a02-43d69382f7d3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078393 Aug 29 23:55:15.253370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 224/430] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:15.264727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:15.279333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:15.299315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.300578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.301715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.303724 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.305408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.306696 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.351151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2a890e31-09fe-4733-9cc8-9c562587abe2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "POST /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.806048 Aug 29 23:55:15.358400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 207/431] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:55:13 2022] POST /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d/os-volume_attachments => generated 194 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:15.600404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:15.601869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:15.633286 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.634459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.637949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.642591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.643571 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.644322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.917706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:15.934085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:15.938424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:15.940970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b9db8654-eeb7-4ae7-8f35-b4d1ae714f00 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1749 microversion: 2.20 time: 0.685597 Aug 29 23:55:15.941869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 225/432] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:15 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1749 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:15.963571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:15.964976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] [instance: dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:15.983700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.985886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.985886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.987262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.988288 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.988943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.010046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] HTTP exception thrown: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Request method failure captured: Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 HTTP/1.1 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVGdbDhVpE_s6W7sKOGVKwjQDl6O510whpUuHlymZOwf6itKc-jtGun-_n56LFcUK1jE76Auz6owrn7cd9ScKxxU45Dlq7X9O4mQJuFRfSTi9nueBatQJc7xF-glP0RWZhLnnO4BLmZcUDpMuxwZyQARuGeSdDezCIo3PbyWNJ8oaBo Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a9642272967c46b188cf1bced9ea6ab5 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesActionsTest-1439290442 Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:55:16.012412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a9642272967c46b188cf1bced9ea6ab5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a9642272967c46b188cf1bced9ea6ab5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a9642272967c46b188cf1bced9ea6ab5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a9642272967c46b188cf1bced9ea6ab5"}]}] Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesActionsTest-1439290442 Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a9642272967c46b188cf1bced9ea6ab5 Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesActionsTest-1439290442 Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesActionsTest-1439290442-project Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 49f2bdc1ced843d7afd419e7e5b7d4e5 Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesActionsTest-1439290442-project Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. Aug 29 23:55:16.013848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4'} Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:16.014578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. Aug 29 23:55:16.015911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:55:16.019665 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] Returning 404 to user: Instance dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:16.020664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ce2e5f1e-5140-43c0-b81f-b7274d87b5db tempest-VolumesActionsTest-1439290442 tempest-VolumesActionsTest-1439290442-project] 10.222.0.90 "GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4" status: 404 len: 111 microversion: 2.1 time: 0.077610 Aug 29 23:55:16.027738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 226/433] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:15 2022] GET /compute/v2.1/servers/dfedc6cb-5732-4ac2-9ad5-6b1705e33fd4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:55:16.241047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:16.251209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d7b06310-7475-4b2b-a863-d7af7005e2b9 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1564 microversion: 2.1 time: 0.667743 Aug 29 23:55:16.252027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 208/434] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:15 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1564 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:16.272676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:16.273319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:16.281084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.281947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.282954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.284322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.285191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.285960 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.399120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5ab30cd1-7cb7-4257-ae03-24ab190cdecf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130416 Aug 29 23:55:16.399936 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 227/435] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:55:16 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:16.989224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:16.990172 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:17.014830 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:17.015374 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:17.019388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:17.020973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:17.020973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:17.021320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:17.540498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:17.561810 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:17.569663 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:17.569663 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c171d424-59cb-41e0-a86a-e76be2240fac tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1749 microversion: 2.20 time: 0.584038 Aug 29 23:55:17.569663 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 209/436] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:16 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1749 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:18.604551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:18.605343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:18.620761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.622251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.623145 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.624853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.625818 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.626671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.853967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.865378 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.866926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.868216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e86d7946-98a4-4929-a2ff-6205e7f6e10e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1749 microversion: 2.20 time: 0.268881 Aug 29 23:55:18.869164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 228/437] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:18 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1749 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:18.975806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:18.999334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.000648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.001709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.028065 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] Creating event network-changed:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:55:19.036837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-7effc9ee-35aa-4d5a-a5c9-69ba66937a58 req-854e75ad-96d5-47d9-b5fd-9e92d0c291a6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072344 Aug 29 23:55:19.037478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 210/438] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:19.895163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:19.895804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:19.903269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.903857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.904521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.905256 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.905723 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.906168 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.072455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:20.085972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:20.089424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:20.090761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f2dd3d11-c507-480f-9912-9cf12477cea0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1751 microversion: 2.20 time: 0.200378 Aug 29 23:55:20.091396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 229/439] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:19 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:21.118182 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:21.119665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:21.127422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.127946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.128414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.129123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.129564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.129993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.321190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.331202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.332948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.334094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-929dedd2-ecb7-4544-923c-6fba7735e109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1751 microversion: 2.20 time: 0.220243 Aug 29 23:55:21.334649 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 211/440] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:21 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:22.362234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:22.364017 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:22.382169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.382771 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.383294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.384897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.385810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.386428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.584580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.595088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.596615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.597898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cf989640-0a08-4b9b-830f-59add875a68a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1751 microversion: 2.20 time: 0.241866 Aug 29 23:55:22.598471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 230/441] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:22 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1751 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:23.624647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:23.625292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:23.632110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.632622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.633056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.633748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.634536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.635024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.773315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.783594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.785135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.786293 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7b8ac37d-13bd-4ad7-92f1-aac6fbb4b876 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1751 microversion: 2.20 time: 0.166145 Aug 29 23:55:23.786850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 212/442] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:23 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:24.811128 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:24.813507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:24.826004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.827772 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.830079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.831768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.832763 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.833419 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.030354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:25.039294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:25.059654 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:25.063064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7ed143b3-e73f-4715-94b5-ae9fbb7bd816 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1751 microversion: 2.20 time: 0.256958 Aug 29 23:55:25.099882 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 231/443] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:24 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1751 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:26.108017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:26.109467 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:26.123327 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.124577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.125663 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.133257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.136979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.137436 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.369338 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.382611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.384746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.386251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5d5236ab-d65b-4648-9340-3110bddadced tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.282129 Aug 29 23:55:26.386951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 213/444] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:26 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:27.411482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:27.412127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:27.421141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.421932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.422833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.423479 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.424003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.424703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.644353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.660462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.667218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.673146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-49ce6341-3a73-4f96-9bd1-57277a2e9d76 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.264957 Aug 29 23:55:27.675787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 232/445] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:27 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:28.705362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:28.706964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:28.710658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=72 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:28.717385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.718173 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.718695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:28.719666 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.720468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.720955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:28.973398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:28.989478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:28.992147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:28.994507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-15323c36-7c70-44a1-bff0-4adad31a09dc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.293488 Aug 29 23:55:28.995248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 214/446] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:28 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:30.030006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:30.033295 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:30.046947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.048512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.049735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.051202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.052653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.053624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.650073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.667824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.670024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.671426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-31c33b62-83eb-446f-bf61-dd898f95e25d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.650492 Aug 29 23:55:30.672509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 233/447] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:30 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:31.712304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:31.714651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:31.722421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.723260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.723868 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.724780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.725400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.725970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.730503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:31.987463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.005725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.007882 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.009498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2e954357-8ddd-4f67-b416-cd228fe57457 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.302179 Aug 29 23:55:32.010069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 215/448] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:31 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:33.038845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:33.039568 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:33.042761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:33.047833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.048363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.048889 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.049502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.050030 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.050383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.220673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.231169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.232722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.233931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c0f745e7-52cc-4871-9e4e-e8cfb2b6c1e3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.199000 Aug 29 23:55:33.234498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 234/449] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:33 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:34.261936 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:34.263555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:34.272319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:34.273129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:34.273569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:34.274594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:34.275475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:34.276090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:34.618952 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:34.633914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:34.636047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:34.650404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-58a64daf-19db-4d4a-b500-b0d148bc1316 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.393205 Aug 29 23:55:34.653618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 216/450] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:34 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:35.679543 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:35.681659 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:35.694957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:35.700377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:35.701579 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:35.702567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:35.703873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:35.704520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:35.746501 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:35.976544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:35.987064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:35.988647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:35.989878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-841cfa52-3d2d-4e87-a959-a35769ebfa04 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.314640 Aug 29 23:55:36.004210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 235/451] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:35 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:37.033337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:37.035035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:37.044521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.045738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.046423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.047570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.048105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.049644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.236600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:37.251890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:37.254630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:37.256713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3732a53d-babe-4bc8-a9c5-771c259f4434 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.228531 Aug 29 23:55:37.257758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 217/452] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:37 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:38.283225 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:38.283851 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:38.291617 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.292106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.292586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.293327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.293780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.294197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.449656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:38.463604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:38.465111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:38.472625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-71d04764-0326-478f-9f03-cf067fb93cb9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.193259 Aug 29 23:55:38.473417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 236/453] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:38 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:39.503527 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:39.505933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:39.522950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.525092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.525759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:39.527279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.528925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.545467 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:39.846814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:39.862651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:39.864669 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:39.866688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-29b90bd4-2d89-4198-a339-3d0daa5cb902 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.371056 Aug 29 23:55:39.868661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 218/454] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:39 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:40.909436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:40.911898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:40.936953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:40.938473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:40.940105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:40.942949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:40.944516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:40.952088 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:41.188751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:41.203111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:41.205331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:41.206807 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2712b513-1905-463b-8bde-9b9093eb0fb6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.308054 Aug 29 23:55:41.207849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 237/455] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:40 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:42.253352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:42.256445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:42.279882 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.283723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.284954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.287007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.288575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.292085 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.522157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:42.537712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:42.540810 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:42.558105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-53c06e3b-87c7-4654-8716-38eb75267f0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.314351 Aug 29 23:55:42.559430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 219/456] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:42 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:43.587504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:43.588419 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:43.609625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.610578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.611198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:43.612285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.612927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.613597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:43.826137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:43.838143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:43.839513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:43.840918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0b1d4a7d-5d20-47e6-8f71-ff455a2d6167 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.258734 Aug 29 23:55:43.841326 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 238/457] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:43 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:44.106740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:44.107380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:44.115336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.116123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.116853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.118610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.119341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.120015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.334225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lazy-loading 'services' on Instance uuid 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:44.734550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4fd5e1a-09af-47a0-9373-fb2548352382 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "DELETE /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d/os-volume_attachments/22944258-7c8e-4aca-a756-13afa7ff0ad8" status: 202 len: 0 microversion: 2.1 time: 0.631675 Aug 29 23:55:44.735796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 220/458] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:55:44 2022] DELETE /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d/os-volume_attachments/22944258-7c8e-4aca-a756-13afa7ff0ad8 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:44.865710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:44.866996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:44.893901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.898900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.899616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.902788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.904538 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.906141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:45.089997 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:45.102698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:45.105357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:45.107304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-35375d72-e5a8-4f47-be4f-d3caaa36d946 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.245570 Aug 29 23:55:45.108649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 239/459] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:44 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:46.134146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:46.134845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:46.142509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.142509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.142509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.142509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.144742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.145039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.296205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:46.306057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:46.307607 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:46.308828 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7174b9b1-a36f-42ca-bd33-7ef530584ed6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.179601 Aug 29 23:55:46.311226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 221/460] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:46 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:47.333585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:47.334186 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:47.342315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.342819 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.343387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.344140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.344672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.345109 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.491499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:47.502472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:47.504040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:47.505306 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cbd6999f-3b5f-4459-b97a-ed7a576484b7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.175934 Aug 29 23:55:47.505873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 240/461] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:47 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:48.529853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:48.530464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:48.537362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.537873 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.538326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.539060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.539519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.539942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.684343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:48.698741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:48.701800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:48.704129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c6406d29-4ec6-4010-87f8-bfa006baf613 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.177734 Aug 29 23:55:48.705148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 222/462] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:48 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:49.732106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:49.732717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:49.738876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.739359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.739786 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.740544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.740957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.741376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.897965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.907461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.908979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.910160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3aeb70df-3117-4ef0-bc87-b952e38d4216 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.182999 Aug 29 23:55:49.910725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 241/463] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:49 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:50.934364 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:50.934917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:50.941792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.942277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.942748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.943461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.943907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.944356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.096593 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.107122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.108673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.109890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b3ec798f-3920-4a16-9937-d27577811559 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.180597 Aug 29 23:55:51.110470 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 223/464] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:50 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:51.188906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:51.189446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:51.196645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.197710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.198147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.198969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.199472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.199909 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.227964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:55:51.443004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-981e1444-cdb2-48d3-a536-afd74b849780 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "DELETE /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 204 len: 0 microversion: 2.1 time: 0.257744 Aug 29 23:55:51.443698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 242/465] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:55:51 2022] DELETE /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:55:51.451901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:51.452528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:51.458852 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.459340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.459777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.460669 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.461124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.461552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.622357 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.630275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-85a6b27a-3ee9-4d1f-971f-8af12799cbcc tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1514 microversion: 2.1 time: 0.182270 Aug 29 23:55:51.630849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 224/466] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:51 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:52.137635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:52.138446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:52.144585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.149530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.149530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.149530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.149530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.150784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.303867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:52.314677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:52.316422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:52.327494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0ef6ce5d-2774-4b98-9659-e888527c5f3c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.185236 Aug 29 23:55:52.327494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 243/467] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:52 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:52.653914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:52.654752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:52.661466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.661955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.662640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.663105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.663601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.664297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.805481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:52.813424 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4bc9449-d45a-46b5-9447-d33701110963 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1514 microversion: 2.1 time: 0.166055 Aug 29 23:55:52.814007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 225/468] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:52 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:53.343484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:53.344195 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:53.350874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.351364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.351795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:53.352526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.353336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.353943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:53.508814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:53.520297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:53.521736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:53.522919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2e47f635-33f0-40ae-a057-6438593906c3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.184141 Aug 29 23:55:53.523490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 244/469] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:53 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:53.835303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:53.835900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:53.843261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.844046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.844846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:53.846141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.846970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.847747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.020897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.033567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-099d082e-f3c7-4b42-8227-58b6d4b1b73b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1514 microversion: 2.1 time: 0.202864 Aug 29 23:55:54.034382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 226/470] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:53 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:54.548245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:54.549656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:54.559407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.560461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.561283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.563512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.564373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.565011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.797564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.808355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.810949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.812552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b0ea4dbf-36bb-4e9c-8ddd-8a940bd09bf7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.270185 Aug 29 23:55:54.813668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 245/471] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:54 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:54.829858 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643bb5c5-0c90-4aa6-b32b-6082a8e40e3d", "name": "network-vif-deleted", "tag": "fc16ae60-96b4-45ec-ac85-c7b2056ef931"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:54.841521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.842149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.842617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.857455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] Creating event network-vif-deleted:fc16ae60-96b4-45ec-ac85-c7b2056ef931 for instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d on hv-cinder-85504 Aug 29 23:55:54.862643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d9d0341c-9cd3-4afe-9fb6-744342653267 req-b087c32a-740f-41a7-9df0-56ac72590183 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036970 Aug 29 23:55:54.863386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 227/472] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:55.057266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:55.058240 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:55.064722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.065778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.066221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:55.066938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.067398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.067828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:55.154440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:55.168715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9444bc38-7f8f-4527-8d26-097671ae395f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1304 microversion: 2.1 time: 0.115689 Aug 29 23:55:55.169794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 246/473] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:55 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:55.837138 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:55.838340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:55.845045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.845655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.845941 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:55.846624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.847075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.847494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.002557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:56.013150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:56.014655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:56.016706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-af24b247-9b33-4718-b3fa-f303adf1f397 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.183769 Aug 29 23:55:56.017403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 228/474] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:55 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:56.193075 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:56.193814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:56.203057 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:56.203543 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:56.203998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.204766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:56.205212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:56.205793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.247694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:56.248461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:56.249204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.249878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lazy-loading 'fault' on Instance uuid 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:56.297782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:56.305220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8f779061-4f61-46f0-94b2-ea64c291b155 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 200 len: 1309 microversion: 2.1 time: 0.117784 Aug 29 23:55:56.305807 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 247/475] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:56 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:56.724991 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "name": "network-vif-plugged", "status": "completed", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:56.735789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:56.736370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:56.736869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.748880 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] Creating event network-vif-plugged:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:55:56.753890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-45d550e6-911d-4e5e-87eb-b7eec5d2eff5 req-0acc736c-10d8-42ca-82fd-90964407c9d4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Aug 29 23:55:56.754523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 229/476] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:57.042402 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:57.043015 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:57.045721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:55:57.045862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Mon Aug 29 23:55:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 (ip 10.222.0.90) !!! Aug 29 23:55:57.052707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:57.053096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:57.053559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:57.054477 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:57.054934 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:57.055361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:57.201806 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:57.211722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:57.214125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:57.215029 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e170b1e5-6e56-4957-b162-7a3b460a47ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.177823 Aug 29 23:55:57.215605 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 248/477] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:57 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:57.329170 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:57.330159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:57.338691 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:57.339472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:57.340213 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:57.341337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:57.346764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:57.346764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:57.359683 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] HTTP exception thrown: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Request method failure captured: Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d HTTP/1.1 Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVGyUmkKoPjQ7eYGelKvCzQe5zqFnL-HPNQ5GL_eUsGJWPuqGD7dfWy6bJOQJOLgu0POaPxW3Vhd1Xwm_vqjeoNJtz3qO-GEKU3T8_7aw1TbkBUZ2jixyhTE2m30XjqJBWgQDlvL3LAuGegmnfxtAsdkGFYEXJN-NF9hP8MMHTz_v3k Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 184afafb4d0b4a089a059eb73eb6ff2a Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:55:57.361377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/184afafb4d0b4a089a059eb73eb6ff2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/184afafb4d0b4a089a059eb73eb6ff2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_184afafb4d0b4a089a059eb73eb6ff2a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/184afafb4d0b4a089a059eb73eb6ff2a"}]}] Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 184afafb4d0b4a089a059eb73eb6ff2a Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotTestJSON-1211203300-project Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: c200edfeb8a649f0a1d5a48f837c023a Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211203300-project Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. Aug 29 23:55:57.363977 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '643bb5c5-0c90-4aa6-b32b-6082a8e40e3d'} Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:57.365674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. Aug 29 23:55:57.368388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:55:57.370638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Returning 404 to user: Instance 643bb5c5-0c90-4aa6-b32b-6082a8e40e3d could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:57.370638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-00f8a48a-f29d-4542-9623-5917a53e356a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d" status: 404 len: 111 microversion: 2.1 time: 0.039387 Aug 29 23:55:57.370638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 230/478] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:57 2022] GET /compute/v2.1/servers/643bb5c5-0c90-4aa6-b32b-6082a8e40e3d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:55:58.238639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:58.239353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:58.246860 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:58.247619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:58.247815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:58.248507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:58.248914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:58.249359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:58.392027 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:58.402114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:58.403998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:58.406147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-96de7c5a-b509-4f96-b923-d1760728e914 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.171426 Aug 29 23:55:58.406723 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 249/479] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:58 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:59.430621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:59.431996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:59.434263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=34 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:59.439017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:59.439502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:59.439939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:59.440798 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:59.441252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:59.441675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:59.579988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:59.589371 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:59.590813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:59.591969 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4de4b49d-cdc9-45af-8a5b-ec2baae666c0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.166104 Aug 29 23:55:59.592550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 231/480] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:59 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:00.615919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:00.616502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:00.623766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:00.624630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:00.625135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:00.625901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:00.626361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:00.626832 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:00.630178 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:00.772880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:00.782311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:00.783756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:00.784949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-23337c2f-0bcf-44eb-824a-ee90f3a65962 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.173117 Aug 29 23:56:00.785517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 250/481] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:00 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:01.807825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:01.808506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:01.814963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:01.815447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:01.815887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:01.816613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:01.817074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:01.817502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:01.958634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:01.960933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:01.968652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:01.970067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:01.971221 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dcbae82f-3823-4622-b5d0-113036ce33d7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.167487 Aug 29 23:56:01.971872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 232/482] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:01 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:02.996762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:02.997408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:03.004519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:03.006760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:03.006760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:03.006760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:03.006760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:03.007217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:03.153330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:03.164013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:03.166068 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:03.167401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cf6c9f70-60a3-4dae-9b87-5bf310b91dd1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1807 microversion: 2.20 time: 0.175641 Aug 29 23:56:03.167973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 251/483] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:02 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:04.193057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:04.193673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:04.201079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:04.201568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:04.202008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:04.202715 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:04.203827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:04.204365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:04.351416 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:04.361740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:04.363189 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:04.365735 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0201b874-e161-47ee-a1a3-55feaa6028b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1794 microversion: 2.20 time: 0.175678 Aug 29 23:56:04.365735 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 233/484] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:04 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1794 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:07.343025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:07.343688 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:07.346123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:07.351361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:07.351894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:07.352402 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:07.353191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:07.353641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:07.354062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:07.487948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lazy-loading 'services' on Instance uuid 6d3de91e-440c-4c11-97f0-8cc634192f45 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:07.750624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1efc8afa-fd5b-4347-a95b-7c7b29f54f30 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments/9edc1af7-22ce-4511-b377-a5110eba0157" status: 202 len: 0 microversion: 2.1 time: 0.412443 Aug 29 23:56:07.751144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 252/485] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:07 2022] DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments/9edc1af7-22ce-4511-b377-a5110eba0157 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:08.096277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1244675808", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "networks": [{"uuid": "54b35e90-eaee-4696-a0d1-a7792bb4e65e"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:08.154207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] validate_networks() for [('54b35e90-eaee-4696-a0d1-a7792bb4e65e', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:56:08.549109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:56:08.549546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:56:08.550148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:56:08.550605 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:56:08.551011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:56:08.562634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.563112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.563538 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.564421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.564895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.565313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.583445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Getting quotas for project 184afafb4d0b4a089a059eb73eb6ff2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:56:08.587479 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Getting quotas for user c200edfeb8a649f0a1d5a48f837c023a and project 184afafb4d0b4a089a059eb73eb6ff2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:56:08.599990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:56:08.602432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:56:08.720017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ae277862-b7f4-442d-a0f9-5fd2bedb90b1 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627488 Aug 29 23:56:08.720750 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 234/486] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:56:08.733663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c432d57c-5cd2-4e06-ac14-8c331af4832d tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:08.734374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c432d57c-5cd2-4e06-ac14-8c331af4832d tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:08.791736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c432d57c-5cd2-4e06-ac14-8c331af4832d tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:08.800203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c432d57c-5cd2-4e06-ac14-8c331af4832d tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1219 microversion: 2.1 time: 0.072219 Aug 29 23:56:08.800809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 253/487] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:08 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:09.822400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:09.823716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:09.833401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.833983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.834418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.835116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.835567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.835995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.907160 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:09.914976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-59142bcf-5909-433a-81ee-c8a1d5e02237 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1223 microversion: 2.1 time: 0.096907 Aug 29 23:56:09.915609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 235/488] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:09 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:09.972990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:09.979943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.980505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.980922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.007926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Going to try to stop instance {{(pid=127669) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 23:56:10.240750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a668aaff-4761-4c48-a44a-a80e717bda7a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action" status: 202 len: 0 microversion: 2.1 time: 0.271399 Aug 29 23:56:10.242279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 254/489] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:56:09 2022] POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:56:10.251443 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:10.252053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:10.258624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.259579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.260145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.261757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.262239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.262736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.405269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:10.414246 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e65e2340-4512-4b9f-b543-d88414c39355 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.166780 Aug 29 23:56:10.414885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 236/490] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:10 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:10.937729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:10.938335 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:10.944663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.945142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.945575 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.946259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.946712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.947129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.017448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:11.025560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-eb40b5b0-b08b-4170-a8e1-bd3d632e73f9 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1271 microversion: 2.1 time: 0.092258 Aug 29 23:56:11.026136 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 255/491] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:10 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:11.435887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:11.436513 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:11.443260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.443745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.444197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.445078 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.445736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.446191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.604199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:11.613040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c3137f62-dbb3-4dab-a120-7573c47f945f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.181530 Aug 29 23:56:11.613540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 237/492] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:11 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:12.048108 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:12.049473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:12.056938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.057543 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.058510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.059218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.059667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.060087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.260571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:12.268990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-560b8f8e-bec0-4fb6-8408-556553da4876 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.225078 Aug 29 23:56:12.269580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 256/493] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:12 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:12.634860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:12.636028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:12.642906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.643396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.643831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.644583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.645040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.645677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.868739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:12.876954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cca69580-311b-48cb-ad7b-e8f464568290 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.246161 Aug 29 23:56:12.877532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 238/494] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:12 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:13.120898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9", "tag": "3c1e79ee-4a00-47c6-9256-e32ed1c62445"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:13.120898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.120898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.120898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.131121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] Creating event network-changed:3c1e79ee-4a00-47c6-9256-e32ed1c62445 for instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 on hv-cinder-85504 Aug 29 23:56:13.136588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-859df9ab-7d45-468a-ad68-fec88511dc44 req-08c545a0-42db-43ba-a5c3-f3ab171ce972 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Aug 29 23:56:13.137599 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 257/495] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:13.290900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.291484 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.298453 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.298932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.299362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.300054 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.301111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.301111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.521283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:13.529576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9588dee5-6d33-406c-a251-0ca4ec9f5b14 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.242458 Aug 29 23:56:13.530153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 239/496] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:13 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:13.899962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.900685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.907877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.908414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.908844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.909544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.909998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.910415 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.065384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:14.073215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-04253b17-4109-42bd-a980-80b0659b3951 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.177647 Aug 29 23:56:14.073792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 258/497] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:13 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:14.549782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:14.550463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:14.557406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.557892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.559121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.560031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.560225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.560581 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.699723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:14.708210 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-48d5ba99-0acf-41f1-b8bb-d34b5c1821ff tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.162172 Aug 29 23:56:14.708802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 240/498] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:14 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:14.972880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc95b4a-9bbd-4b03-ab54-7308f3ed69af"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:14.975072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:14.981574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.983588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.983588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.983588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.983588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.984204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.096630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:15.097273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:15.103207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.103689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.104123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.104839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.105297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.105720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.240315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:15.248468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2552caa1-6e4e-4c31-8382-7d57ebed2b63 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.155701 Aug 29 23:56:15.253714 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 241/499] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:15 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:15.731778 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:15.732522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:15.741925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.744573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.744573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.746183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.747046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.747906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.294553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:16.302835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-54398fd4-ec64-43e1-913c-a8de256e8c70 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.575028 Aug 29 23:56:16.312111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 242/500] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:15 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:16.320545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9d55d87c-50c5-40dc-9928-4278c45a1471 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.351504 Aug 29 23:56:16.325739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:16.329950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:16.332942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 259/501] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:14 2022] POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 194 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:16.340748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.341740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.348312 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.349153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.349642 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.350083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.595307 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:16.604385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-12d040b6-ba93-46d9-acdb-51ae1dfbf54e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.291023 Aug 29 23:56:16.608348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 243/502] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:16 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:17.335655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.336871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.346968 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.347616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.348363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.349450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.350025 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.350637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.554087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:17.569443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-652c1290-997f-4c5c-87c9-2822f47a399c tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.249427 Aug 29 23:56:17.570565 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 260/503] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:17 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:17.629414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.630283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.639304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.640028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.640888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.642014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.642687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.643226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.829330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:17.840682 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c0783ea1-e556-4148-a189-a471505818c6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.216777 Aug 29 23:56:17.842814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 244/504] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:17 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:18.592350 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:18.592989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:18.599776 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.600113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.600592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.601303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.601757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.602195 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.746405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:18.754817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9f8e0abc-aac7-449f-adf9-733362eea873 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.167405 Aug 29 23:56:18.755425 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 261/505] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:18 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:18.866972 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:18.867689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:18.869755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.870496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.876101 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.876612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.877047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.877753 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.878307 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.878741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.885757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9", "name": "network-vif-plugged", "status": "completed", "tag": "3c1e79ee-4a00-47c6-9256-e32ed1c62445"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:18.893120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:18.897236 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.897718 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.898142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.909953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] Creating event network-vif-plugged:3c1e79ee-4a00-47c6-9256-e32ed1c62445 for instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 on hv-cinder-85504 Aug 29 23:56:18.915064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-641e6875-ffb2-45fd-b842-627ff695f715 req-0462b74a-e218-4136-ad55-3b3de00d2ebe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Aug 29 23:56:18.915691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 262/506] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:19.038063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.046975 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ab58f958-45bb-4208-ae98-f6d9f4398652 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.183738 Aug 29 23:56:19.047631 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 245/507] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:18 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:19.779851 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:19.780565 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:19.787075 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.787563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.788140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.788872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.789327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.789745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.930160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.938789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-54f6057f-6ab3-4d8a-935e-f509fdde9f4b tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1319 microversion: 2.1 time: 0.164892 Aug 29 23:56:19.939362 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 263/508] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:19 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:20.069640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:20.070229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:20.078115 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.078601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.079036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.079842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.080323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.080750 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.223798 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:20.233003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d0a94117-6f1d-4b5a-9b52-bb1477b2774f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.167300 Aug 29 23:56:20.233595 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 246/509] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:20 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:20.962457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:20.963014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:20.971802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.976514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.976514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.976514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.976514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.977519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.143626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:21.156880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-95293601-eabe-44d4-b486-db6c361cd953 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.198148 Aug 29 23:56:21.162261 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 264/510] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:20 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:21.178466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73838f2d-272d-4c4f-af58-74e4a2035b57", "device": "/dev/sdb"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:21.180972 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.188873 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.191059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.191059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.191059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.191342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.191623 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.255291 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:21.255919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.262908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.263113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.263498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.264258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.264710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.265135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.418720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:21.429365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1b7825f1-1a82-48f1-b11e-3f0c6f252cc9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.178059 Aug 29 23:56:21.431071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 265/511] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:21 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:21.615134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:21.615618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.623407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.627092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.627092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.627092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.627092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.627592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.628819 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:21.651368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2a154ba9-1567-491a-85f2-0f7e99ffbf18 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/ips" status: 200 len: 150 microversion: 2.1 time: 0.040086 Aug 29 23:56:21.652217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 266/512] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:56:21 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:21.663911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189075e3-d732-422f-828c-5ac936e7eb90"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:21.666333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.673697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.674258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.674810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.675809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.676353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.677347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.819360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: POST /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/os-volume_attachments HTTP/1.1 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 74 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:56:21.821138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {"volumeAttachment": {"volumeId": "189075e3-d732-422f-828c-5ac936e7eb90"}} Aug 29 23:56:21.824386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'server_id': '9887a44d-5fe2-4e65-aab4-5123e84fd9b6', 'body': {'volumeAttachment': {'volumeId': '189075e3-d732-422f-828c-5ac936e7eb90'}}} Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:21.826414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:21.833712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 400 to user: Invalid volume: volume 189075e3-d732-422f-828c-5ac936e7eb90 is already attached to instances: 13772077-dc96-4813-925d-975c5748e4d1 {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-aedcba19-19be-41b0-952e-078955c0aa95 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162779 Aug 29 23:56:21.836759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 267/513] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:21 2022] POST /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 23:56:21.837885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:21.837885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.841741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.842309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.842782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.843600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.844422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.844987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.875551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:22.100450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5d8a95d4-2d34-4927-94a4-744e9070d4e2 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "POST /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924612 Aug 29 23:56:22.106621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 247/514] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:21 2022] POST /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:22.226096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-644a1053-2a56-4da4-a831-26c6ff2c49c6 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 204 len: 0 microversion: 2.1 time: 0.395833 Aug 29 23:56:22.227384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 268/515] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:21 2022] DELETE /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:56:22.237025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:22.237979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:22.244449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.245011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.245958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.246655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.247113 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.247534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.394795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:22.397144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:22.403863 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2498ad8b-4dd4-4ccd-a3bf-4ed38181fa40 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1681 microversion: 2.1 time: 0.171306 Aug 29 23:56:22.408148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 248/516] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:22 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:22.458878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:22.459612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:22.466672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.467176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.467608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.468377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.468935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.469361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.628302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:22.638900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c77bc482-d6a1-4653-bd62-5164b6cc1084 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.184759 Aug 29 23:56:22.639492 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 269/517] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:22 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:23.425128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:23.425680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:23.438058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:23.438565 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:23.439003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:23.439794 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:23.440337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:23.440746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:23.599742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:23.608657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-41750b78-47f8-4b9d-bc3d-b35739b66200 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1681 microversion: 2.1 time: 0.187247 Aug 29 23:56:23.609340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 249/518] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:23 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:23.660075 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:23.660846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:23.667707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:23.668285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:23.668764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:23.669470 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:23.669923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:23.670342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:23.817147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:23.825121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-27f65593-5727-49d0-ae7d-7b997df7a49f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.168872 Aug 29 23:56:23.829931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 270/519] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:23 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:24.631088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:24.631681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:24.638927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.639404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.639841 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.640576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.641032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.641457 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.857556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:24.859612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:24.873975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.874739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.875337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.876320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.876942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.877524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.965677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:24.977050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bac97f3e-a9e5-4149-9d00-a205ff1e0a83 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1681 microversion: 2.1 time: 0.348315 Aug 29 23:56:24.977050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 250/520] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:24 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:25.059477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:25.061971 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:25.068069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:25.068588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:25.069017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.069728 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:25.070174 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:25.070589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.096234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'flavor' on Instance uuid 566e2dc8-23df-460a-bc9e-6d686006f9ef {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:25.105961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:25.114383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2d40981c-8b7d-469e-a449-d1f55717b27c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1676 microversion: 2.1 time: 0.267808 Aug 29 23:56:25.114977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 271/521] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:24 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:25.572318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d6d91593-a906-4d6b-862e-1c229620abf4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/action" status: 200 len: 32 microversion: 2.1 time: 0.519373 Aug 29 23:56:25.574641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 251/522] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:56:25 2022] POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/action => generated 32 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:56:25.584692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:25.585308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:25.592791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:25.594207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:25.594207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.594570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:25.594890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:25.595311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.695040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9887a44d-5fe2-4e65-aab4-5123e84fd9b6", "name": "network-vif-deleted", "tag": "f86aed97-d345-4c61-b637-b4d4771086c3"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:25.718337 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:25.718820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:25.719303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.733597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] Creating event network-vif-deleted:f86aed97-d345-4c61-b637-b4d4771086c3 for instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 on hv-cinder-85504 Aug 29 23:56:25.739245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-70a72bcd-b752-4faa-a5c5-64d1d622b823 req-ef6163b5-3b49-441e-8d25-aba49fecb1b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050201 Aug 29 23:56:25.740500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 252/523] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:25.768382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:25.777481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-27f05f4c-de95-4a84-8a4b-559fa5990808 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.197337 Aug 29 23:56:25.777998 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 272/524] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:25 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:26.002071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:26.003161 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:26.011975 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.013316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.013978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.015066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.016050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.016776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.142219 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:26.143799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:26.150920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.153235 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.153814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.155150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.155830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.156635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.185989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:26.197936 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a804c40c-b6d8-4ea5-9ad9-72523f454aaf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 200 len: 1326 microversion: 2.1 time: 0.200187 Aug 29 23:56:26.200081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 253/525] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:25 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 1326 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:26.432561 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:26.442314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d50db9ff-ce0c-4b10-8827-69695c88eb83 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1653 microversion: 2.1 time: 0.303989 Aug 29 23:56:26.443092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 273/526] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:26 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1653 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:26.466105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:26.476318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.477106 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.477684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.532990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Going to try to start instance {{(pid=127670) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 23:56:26.693296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ea8070d3-79db-4c00-9ca7-1457058aede1 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action" status: 202 len: 0 microversion: 2.1 time: 0.230427 Aug 29 23:56:26.694489 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 254/527] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:56:26 2022] POST /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:26.705743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:26.706353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:26.715207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.715838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.716361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.717097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.717565 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.717992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.801628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:26.802333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:26.831456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.832624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.833242 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.834197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.834886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.838128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.907297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:26.916223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-988b90ba-927d-44e2-ac3f-e020f65069f0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1662 microversion: 2.1 time: 0.214920 Aug 29 23:56:26.923886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 274/528] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:26 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1662 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:27.042547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:27.051617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bcc2de9d-d515-4717-bd16-931be421adc5 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.255894 Aug 29 23:56:27.052544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 255/529] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:26 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:27.221337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:27.221997 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:27.231360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.232796 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.233809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.234747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.235515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.236344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.254398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 HTTP/1.1 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:56:27.258359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:56:27.259720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '9887a44d-5fe2-4e65-aab4-5123e84fd9b6'} Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:27.260485 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:56:27.263010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:27.264609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:27.264609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-99701bb5-1a01-4760-a50d-92caddceae7d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 404 len: 111 microversion: 2.1 time: 0.041140 Aug 29 23:56:27.268999 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 275/530] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:27 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:27.273637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7705b01d-fd61-421c-8587-44c71e831615 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '.version_select at 0x7fd5a6541700>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:27.392115 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7705b01d-fd61-421c-8587-44c71e831615 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666743028" status: 202 len: 0 microversion: 2.1 time: 0.122202 Aug 29 23:56:27.393193 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 256/531] 10.222.0.90 () {58 vars in 1221 bytes} [Mon Aug 29 23:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666743028 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:27.949426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:27.950322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:27.957657 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.958165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.958597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.959364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.959975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.971940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.088579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:28.091506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:28.114148 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.115068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.115888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.117710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.120958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.122422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.191525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.203635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-519ea487-fb70-4316-a52b-87b0f9732a15 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1662 microversion: 2.1 time: 0.261559 Aug 29 23:56:28.204645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 276/532] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:27 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1662 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:28.356436 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.365784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d973e687-2b77-48d5-93f1-ccc327b13a39 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.292371 Aug 29 23:56:28.366632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 257/533] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:28 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:28.449981 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:28.450569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:28.460424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.460818 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.461392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.462560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.463655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.465406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.563811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'services' on Instance uuid 13772077-dc96-4813-925d-975c5748e4d1 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:28.789802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-60e2f298-2be4-4f29-945f-ed01c0c8c05b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments/189075e3-d732-422f-828c-5ac936e7eb90" status: 202 len: 0 microversion: 2.1 time: 0.346452 Aug 29 23:56:28.790448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 277/534] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:28 2022] DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments/189075e3-d732-422f-828c-5ac936e7eb90 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:28.799706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:28.801861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:28.808552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.809051 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.809486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.810276 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.810766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.811192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.843705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ffa1b026-47d6-4e49-b243-b9b786f0dce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047935 Aug 29 23:56:28.844307 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 258/535] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:28 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:29.227809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:29.228670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:29.238301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.238784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.239214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.239907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.240396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.240813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.383283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.387790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:29.389063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:29.392508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4ff9e217-3496-4f9a-812c-980783612ece tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1666 microversion: 2.1 time: 0.168995 Aug 29 23:56:29.396022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.396617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.397132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.397907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.398437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.398997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.404364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 278/536] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:29 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1666 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:29.543861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.552130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-217da718-1c42-4d48-9267-2d611cff5123 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.169112 Aug 29 23:56:29.552710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 259/537] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:29 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:29.856643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:29.858876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:29.865597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.867247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.867247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.867247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.867739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.868161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.900411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-28170630-d08f-40a3-a47e-28ba19480f1d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 Aug 29 23:56:29.900880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 279/538] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:29 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:30.573922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:30.575088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:30.577192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:30.582214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.582704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.583140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.583843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.584332 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.584755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.721289 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:30.729768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b5773665-bc88-47a9-983c-75e377be446f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.160487 Aug 29 23:56:30.731057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 260/539] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:30 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:30.913974 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:30.916221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:30.923761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.924302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.924746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.925462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.925918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.926339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.959325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c1f1460a-f9df-4479-a4c4-3c5af9fd2cdb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049367 Aug 29 23:56:30.959914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 280/540] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:30 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:31.752633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:31.753252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:31.760002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.760525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.760962 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.762282 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.762904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.763335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.908996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:31.917606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c431ceac-c55b-4aa6-9aeb-b9806aca90df tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.168729 Aug 29 23:56:31.918279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 261/541] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:31 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:31.973731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:31.975957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:31.982925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.983422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.984292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.984764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.985295 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.985808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.004648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:32.022669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9d7d97e1-5a7b-4687-a35b-6481b80d46b4 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053885 Aug 29 23:56:32.023265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 281/542] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:31 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:32.938928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:32.939478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:32.946088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:32.946661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:32.947200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.947978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:32.949305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:32.949833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.035431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:33.037732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:33.044982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.045727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.046202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.046910 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.047449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.047878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.080249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8a2cfd46-7f89-40a3-9ba4-f0f3652f15a9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049032 Aug 29 23:56:33.081016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 282/543] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:33 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:33.092101 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:33.100513 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ad30639-ea93-45d5-85c3-af2817f701cc tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.165406 Aug 29 23:56:33.101076 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 262/544] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:32 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:34.092235 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:34.094371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:34.101660 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.102155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.102591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.103293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.103748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.104243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.123261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:34.124019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:34.130997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.131492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.131932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.132678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.133137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.133564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.142498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b0ef4063-618b-40a4-a365-ac3fa6c05964 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054310 Aug 29 23:56:34.143281 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 283/545] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:34 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:56:34.207782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:34.208307 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:34.214925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.215427 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.216066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.216830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.217298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.217725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.244948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:34.275757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.285418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d647917d-fe21-464a-a5ff-d00301179ae1 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.167168 Aug 29 23:56:34.286057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 263/546] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:34 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:34.591197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-99474aac-8f84-4b72-ba59-d21edead513b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 204 len: 0 microversion: 2.1 time: 0.387263 Aug 29 23:56:34.591894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 284/547] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:34 2022] DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:56:34.602264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:34.602871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:34.611154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.611706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.612197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.612964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.613465 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.614013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.619828 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:34.819743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.829623 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7e1c59a2-b8d1-4789-ac6f-94eda439fb6b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.232425 Aug 29 23:56:34.830209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 264/548] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:34 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:35.310740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:35.311551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:35.319902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.320445 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.323122 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.324621 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.325090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.325516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.487915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:35.497584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f743fd32-0407-46af-9e04-a7e8fd7927db tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.191976 Aug 29 23:56:35.498172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 285/549] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:35 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:35.859288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:35.859824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:35.866618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.867102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.867525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.868306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.868755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.869175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.025907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.036912 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8451c20c-1423-4c3a-828a-9a827e056923 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.182349 Aug 29 23:56:36.037500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 265/550] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:35 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:36.519358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:36.520039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:36.527561 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.528229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.528682 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.529407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.529875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.530302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.683553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.692046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ba09fb21-8906-4db5-af05-5c207a840c6c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.176582 Aug 29 23:56:36.692745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 286/551] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:36 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:37.059343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:37.059910 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:37.066626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.067176 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.067684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.069090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.069090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.069859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.219779 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.228060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ebf0e47-a116-452e-9535-928c621462fe tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.173799 Aug 29 23:56:37.228667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 266/552] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:37 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:37.714783 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:37.715336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:37.717735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.722444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.722921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.723346 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.724028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.724506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.724926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.865397 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.874512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-73f7b50b-15aa-43c9-a091-68627ce96229 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.164213 Aug 29 23:56:37.875101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 287/553] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:37 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:38.251437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:38.252151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:38.258914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.259398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.259826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.260558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.261241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.261756 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.411671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:38.420380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4d9a671-4b93-4b10-93c8-670f7924143f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.172674 Aug 29 23:56:38.420987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 267/554] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:38 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:38.896887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:38.897534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:38.905284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.905768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.906198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.906894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.907403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.907825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.064286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:39.074250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b2e3f6ac-e7c9-4b61-9232-40b41d19774f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.181239 Aug 29 23:56:39.074892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 288/555] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:38 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:39.442678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:39.443301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:39.451320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.451804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.452265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.452960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.453408 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.453825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.592673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:39.600494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4c4265a2-baf7-4fd9-a0ab-fa1a271dce69 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.161742 Aug 29 23:56:39.601073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 268/556] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:39 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:40.095253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:40.095913 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:40.102756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.103244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.103679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.104450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.105048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.105477 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.247798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:40.256506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-429d165f-27a7-4f01-acdd-e85d3bab6a81 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.165090 Aug 29 23:56:40.257096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 289/557] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:40 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:40.622422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:40.623030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:40.629949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.630437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.630869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.631565 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.632019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.632472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.797050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:40.805130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8d25614f-a634-4a85-9eec-abd0a5ce726b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.186653 Aug 29 23:56:40.805739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 269/558] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:40 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:41.279327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:41.279910 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:41.287084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.287569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.288007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.288743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.289200 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.289628 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.431689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:41.441147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-35fb1946-16f7-4fef-a517-54e7f362f6f6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.166525 Aug 29 23:56:41.441741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 290/559] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:41 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:41.827906 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:41.829819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:41.836891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.837650 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.838335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.840498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.841317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.842062 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.994201 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.002285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-25a86c34-1613-40e7-bbe3-a9103a323341 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1682 microversion: 2.1 time: 0.178972 Aug 29 23:56:42.002883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 270/560] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:41 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:42.463650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:42.464392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:42.473036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.473676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.474277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.475449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.476069 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.476753 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.717218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.726901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-820ad8bd-3fbb-424d-a8c4-29e1dc6fa15f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.267251 Aug 29 23:56:42.727509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 291/561] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:42 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:43.028610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:43.029463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:43.037924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.038450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.038902 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.039722 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.040301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.040760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.143945 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:43.153033 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8203f37f-c74c-4901-b64a-2ffb46b0edcb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1614 microversion: 2.1 time: 0.133336 Aug 29 23:56:43.153630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 271/562] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:43 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:43.357422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13772077-dc96-4813-925d-975c5748e4d1", "name": "network-vif-deleted", "tag": "6887f59b-e47e-4f9a-a537-7f002f8c2044"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:43.372670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.373159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.373597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.404140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] Creating event network-vif-deleted:6887f59b-e47e-4f9a-a537-7f002f8c2044 for instance 13772077-dc96-4813-925d-975c5748e4d1 on hv-cinder-85504 Aug 29 23:56:43.411650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-7d222acb-fb7a-456a-b764-f7b80c499364 req-082018aa-df52-4cf6-8f75-622153f8e081 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059406 Aug 29 23:56:43.413081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 292/563] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:43.749796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:43.750563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:43.756932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.757425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.757864 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.758579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.759092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.759528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.934560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:43.944131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2f78b882-7ed4-487a-a1e6-0593d478d1cb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1735 microversion: 2.1 time: 0.198302 Aug 29 23:56:43.945085 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 272/564] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:43 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:44.178463 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:44.181348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:44.194606 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.195191 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.197061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.212964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.214339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.215468 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.309472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:44.318295 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4c785d17-0ce0-46bf-8e71-18eb0f383ac1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1326 microversion: 2.1 time: 0.147332 Aug 29 23:56:44.318974 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 293/565] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:44 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:44.967875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:44.968516 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:44.975116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.975611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.976129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.976951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.977402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.977824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.125039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:45.136095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dbcd3b7a-a4b6-427f-9385-7b0bb778274b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1715 microversion: 2.1 time: 0.172534 Aug 29 23:56:45.136787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 273/566] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:44 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:45.259376 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.259942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.268354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.269193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.269958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.271157 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.271920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.272668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.352393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.353015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.361744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.362241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.362684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.363454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.363913 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.364369 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.407314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.407807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.408309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.408878 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'fault' on Instance uuid 13772077-dc96-4813-925d-975c5748e4d1 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:45.415177 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] HTTP exception thrown: Cannot 'detach_volume' instance 566e2dc8-23df-460a-bc9e-6d686006f9ef while it is in vm_state rescued Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Request method failure captured: Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments/5fc95b4a-9bbd-4b03-ab54-7308f3ed69af HTTP/1.1 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFAIYASVtzH8JeVcHwa69nydl0Tv19W5_1V5CSGCBW2E6APPLk4OonL7nP5kECIVsOFEF893nArkpLrzBaoM5X9ifoM9ftGNiJFK0-wrERv83WNqg_QY270UP0YnhIyB4_DH7oiNKu7QKczKs6G0LKa6J9fMywaIJzHCkro-Bcy0i0 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:56:45.417826 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dc817de5d4ef4812a2fee6ebe0895889", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}] Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 57998546e6a64d42ba3ded9f3267e6af Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:56:45.421216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Cannot 'detach_volume' instance 566e2dc8-23df-460a-bc9e-6d686006f9ef while it is in vm_state rescued Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'server_id': '566e2dc8-23df-460a-bc9e-6d686006f9ef', 'id': '5fc95b4a-9bbd-4b03-ab54-7308f3ed69af'} Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:45.422072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 566e2dc8-23df-460a-bc9e-6d686006f9ef while it is in vm_state rescued Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 566e2dc8-23df-460a-bc9e-6d686006f9ef while it is in vm_state rescued Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:45.423366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Returning 409 to user: Cannot 'detach_volume' instance 566e2dc8-23df-460a-bc9e-6d686006f9ef while it is in vm_state rescued {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:45.424467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c6ed1a84-1f26-4e45-bdbb-ad5fec7de9b6 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments/5fc95b4a-9bbd-4b03-ab54-7308f3ed69af" status: 409 len: 152 microversion: 2.1 time: 0.164072 Aug 29 23:56:45.424467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 294/567] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:45 2022] DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments/5fc95b4a-9bbd-4b03-ab54-7308f3ed69af => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:56:45.429731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:45.430285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.437512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.438650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.439155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.439875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.440424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.441117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.458283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:45.466667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-151b3352-b915-4922-88c4-8187036384ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 200 len: 1331 microversion: 2.1 time: 0.130049 Aug 29 23:56:45.471464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 274/568] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:45 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:45.765550 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-91e8d98a-8fb5-4dee-b0d6-23dffc33c9e7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/action" status: 202 len: 0 microversion: 2.1 time: 0.339521 Aug 29 23:56:45.766388 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 295/569] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 23:56:45 2022] POST /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:45.776988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.777696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.788924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.788924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.788924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.788924 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.790710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.790710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.800795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.801387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.808152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.808686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.809129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.809887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.810383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.810811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.815523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:45.928634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lazy-loading 'services' on Instance uuid 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:46.003542 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:46.014898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a4c2fc75-cfb1-43c9-a466-8a86da08d5ab tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1723 microversion: 2.1 time: 0.244093 Aug 29 23:56:46.015873 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 275/570] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:45 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:46.172930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8ade5cdf-803c-4350-add2-7c36bb57bf8f tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9/os-volume_attachments/73838f2d-272d-4c4f-af58-74e4a2035b57" status: 202 len: 0 microversion: 2.1 time: 0.376412 Aug 29 23:56:46.173897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 296/571] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:45 2022] DELETE /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9/os-volume_attachments/73838f2d-272d-4c4f-af58-74e4a2035b57 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:56:46.489949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:46.491510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:46.499537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:46.499537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:46.499537 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:46.500200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:46.500200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:46.500512 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:46.515538 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 HTTP/1.1 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:56:46.517239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:56:46.519729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '13772077-dc96-4813-925d-975c5748e4d1'} Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:46.521452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:56:46.524094 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.526762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:46.526762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ba54b79c-9c13-4e92-83bc-1bd2fde315ef tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 404 len: 111 microversion: 2.1 time: 0.032721 Aug 29 23:56:46.526762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 276/572] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:46 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:46.530592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5d4c53f0-53fd-4622-83ee-a00ed609982d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '.version_select at 0x7fd5a648eaf0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:46.631389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5d4c53f0-53fd-4622-83ee-a00ed609982d tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985689535" status: 202 len: 0 microversion: 2.1 time: 0.105553 Aug 29 23:56:46.631980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 297/573] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985689535 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:56:47.043760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:47.044832 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:47.053692 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:47.054265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:47.054832 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:47.055868 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:47.056544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:47.057081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:47.231946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:47.242175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6677e38e-81de-4013-bfe0-712ea79446a2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1723 microversion: 2.1 time: 0.203749 Aug 29 23:56:47.242781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 277/574] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:47 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:47.645881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bc4fb4c1-9e31-4569-8a77-84805cdd99fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: .version_select at 0x7fd5a64a8700>, body: {"keypair": {"name": "tempest-keypair-809885816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG4PchM7D8XL8PWcLituq5NnCTlGPNQxPRQaMzmdtZTVQkD5isxCc8efCnP+ZRtrh8eT+Td8bw90dPH800KHCYaWGFzq3sAKKs73afSqka+128tjkpvT1qGUk4Z/t2Hzg=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:47.663644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-bc4fb4c1-9e31-4569-8a77-84805cdd99fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:56:47.668966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-bc4fb4c1-9e31-4569-8a77-84805cdd99fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:56:47.780377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bc4fb4c1-9e31-4569-8a77-84805cdd99fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138781 Aug 29 23:56:47.780916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 298/575] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:56:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:48.264208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.265043 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:48.271956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.272511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.272949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.273675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.274137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.274573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.409555 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.410216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:48.416444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.417725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.418172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.419006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.419465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.419917 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.426297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:48.435315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7569db0a-4b39-4f38-9d00-7a843e6f3c83 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1723 microversion: 2.1 time: 0.175113 Aug 29 23:56:48.435827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 278/576] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:48 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:48.447240 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:48.826772 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9e535658-56bb-46ef-9e16-0379f9251cbe tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 204 len: 0 microversion: 2.1 time: 0.420720 Aug 29 23:56:48.827566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 299/577] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:48 2022] DELETE /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:56:48.836847 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.837461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:48.845184 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.845672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.846098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.847035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:48.847684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:48.848355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:48.992295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:49.000889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-920377e8-e908-42e6-956c-76b361341cf6 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1514 microversion: 2.1 time: 0.168443 Aug 29 23:56:49.001471 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 279/578] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:48 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:49.457980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:49.458676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:49.465046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:49.465535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:49.465982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:49.466686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:49.467525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:49.467697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:49.630791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:49.640432 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-57005ea0-a73c-495b-9a7e-eed472cf67a4 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1723 microversion: 2.1 time: 0.186937 Aug 29 23:56:49.641020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 300/579] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:49 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:50.022978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:50.023625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:50.031275 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.031762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.032295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.033011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.033493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.033909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.229934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:50.239146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-81a98aa5-4740-4ce4-b089-ae8e713c3c0a tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1514 microversion: 2.1 time: 0.220053 Aug 29 23:56:50.239745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 280/580] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:50 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:50.348652 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2067409123", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b40027-b034-467e-a623-8d465afe9154"}], "security_groups": [{"name": "tempest-securitygroup--226566183"}], "key_name": "tempest-keypair-809885816", "user_data": "}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:50.473634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] validate_networks() for [('60b40027-b034-467e-a623-8d465afe9154', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:56:50.663011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:50.663746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:50.670288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.670774 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.671208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.672146 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.672630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.673056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.675839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:50.905771 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:50.922477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d54ffa32-9486-4ed9-8ab3-60dd512cb9f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1729 microversion: 2.1 time: 0.263546 Aug 29 23:56:50.923562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 281/581] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:50 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:50.944887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:50.945394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:50.951715 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.952242 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.952682 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.953495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.953960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.954385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.962427 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:56:50.962954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:56:50.963578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:56:50.964077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:56:50.964683 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:56:50.974598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.975081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.976600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.976600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:50.976785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:50.977197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:50.998734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:56:51.002674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:56:51.016603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:56:51.018966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:56:51.052628 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a25040fb-cd3d-4168-8059-eea6b64c1935 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111640 Aug 29 23:56:51.053326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 282/582] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:56:50 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:51.133270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-daed9867-0eb6-472f-9b81-019f7039b945 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.788768 Aug 29 23:56:51.134897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 301/583] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:56:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:56:51.155620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-57ff2ca5-dc2c-4557-b9eb-a9327d5fb0c2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:51.156462 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-57ff2ca5-dc2c-4557-b9eb-a9327d5fb0c2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:51.222851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57ff2ca5-dc2c-4557-b9eb-a9327d5fb0c2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:51.233403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-57ff2ca5-dc2c-4557-b9eb-a9327d5fb0c2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1241 microversion: 2.1 time: 0.086106 Aug 29 23:56:51.233988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 283/584] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:51 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:51.264293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:51.264912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:51.271862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:51.272299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:51.272947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:51.273663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:51.274112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:51.274630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:51.543160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:51.552742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f0c6df72-34d1-41ed-adbc-6236120a3e28 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1514 microversion: 2.1 time: 0.293067 Aug 29 23:56:51.553570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 302/585] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:51 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:52.117927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9", "name": "network-vif-deleted", "tag": "3c1e79ee-4a00-47c6-9256-e32ed1c62445"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:52.133116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.133624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.134048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.146567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] Creating event network-vif-deleted:3c1e79ee-4a00-47c6-9256-e32ed1c62445 for instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 on hv-cinder-85504 Aug 29 23:56:52.154283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-b2c86f9c-3719-47f9-a695-a8c97f34fd87 req-1a1955b3-67d3-4e43-b383-c60f2a14d32d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039890 Aug 29 23:56:52.154921 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 284/586] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:52.258792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:52.271701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:52.271701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.271701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.274223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.275855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.276643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.277839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.323483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:52.363056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.363056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.363056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.383813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] Creating event network-changed:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:56:52.393665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ce2815a3-619a-47a0-ac6e-05bd49d47e75 req-aeae3436-a878-4444-80c2-63c06fc8588d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076669 Aug 29 23:56:52.395608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 285/587] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:52.455208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:52.468110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-70c950f8-51c6-4df1-ba26-7016660549e5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1245 microversion: 2.1 time: 0.216415 Aug 29 23:56:52.470186 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 303/588] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:52 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1245 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:52.575951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:52.577015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:52.583923 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.584497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.585375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.586214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.586805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.587309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.624235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.625154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.625599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.626096 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lazy-loading 'fault' on Instance uuid 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:52.861789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200edfeb8a649f0a1d5a48f837c023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184afafb4d0b4a089a059eb73eb6ff2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:52.873635 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a163eaff-12b2-4a5d-90cc-40e3bbeaf839 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 200 len: 1309 microversion: 2.1 time: 0.302802 Aug 29 23:56:52.884286 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 286/589] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:52 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:53.244895 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.246668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.259109 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.259890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.261410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.262311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.262937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.263511 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.307186 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-71cf73db-e9dc-431d-be9e-e8ff83b9be08 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments/e4dc5ca2-0255-49d2-9e8c-7968f2e71208" status: 200 len: 194 microversion: 2.20 time: 0.072064 Aug 29 23:56:53.308969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 304/590] 10.222.0.90 () {60 vars in 1454 bytes} [Mon Aug 29 23:56:53 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments/e4dc5ca2-0255-49d2-9e8c-7968f2e71208 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:53.427854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.428472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.440673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.443281 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.443949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.444894 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.445370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.445797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.507660 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.508719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.524098 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.524669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.525111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.532562 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.535770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.535770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.569735 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lazy-loading 'services' on Instance uuid 39819963-dd3d-4079-a0a1-d21a46d4a420 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:53.709824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:53.724296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c266ffd3-625e-4fdd-8e02-45adab3992a3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1293 microversion: 2.1 time: 0.221958 Aug 29 23:56:53.725266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 305/591] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:53 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:53.898033 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-46868280-20f7-43e8-b8a5-1c954f83dac1 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments/e4dc5ca2-0255-49d2-9e8c-7968f2e71208" status: 202 len: 0 microversion: 2.20 time: 0.478686 Aug 29 23:56:53.898558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 287/592] 10.222.0.90 () {60 vars in 1457 bytes} [Mon Aug 29 23:56:53 2022] DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments/e4dc5ca2-0255-49d2-9e8c-7968f2e71208 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:56:53.909962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.910866 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] [instance: 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.913681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.915975 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.918253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.918787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.919188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.919937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.920609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.921037 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.923309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.924032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.924598 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.925435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.926015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.926583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.938423 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] HTTP exception thrown: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Request method failure captured: Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 HTTP/1.1 Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVGyUmkKoPjQ7eYGelKvCzQe5zqFnL-HPNQ5GL_eUsGJWPuqGD7dfWy6bJOQJOLgu0POaPxW3Vhd1Xwm_vqjeoNJtz3qO-GEKU3T8_7aw1TbkBUZ2jixyhTE2m30XjqJBWgQDlvL3LAuGegmnfxtAsdkGFYEXJN-NF9hP8MMHTz_v3k Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 184afafb4d0b4a089a059eb73eb6ff2a Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:56:53.940096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/184afafb4d0b4a089a059eb73eb6ff2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/184afafb4d0b4a089a059eb73eb6ff2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_184afafb4d0b4a089a059eb73eb6ff2a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/184afafb4d0b4a089a059eb73eb6ff2a"}]}] Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 184afafb4d0b4a089a059eb73eb6ff2a Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211203300 Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesSnapshotTestJSON-1211203300-project Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: c200edfeb8a649f0a1d5a48f837c023a Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211203300-project Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. Aug 29 23:56:53.942922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9'} Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:53.944552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. Aug 29 23:56:53.946894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:56:53.949596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] Returning 404 to user: Instance 7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:53.949596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5c28b1e2-8034-44f4-b9a3-8c54f5ef80d7 tempest-VolumesSnapshotTestJSON-1211203300 tempest-VolumesSnapshotTestJSON-1211203300-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9" status: 404 len: 111 microversion: 2.1 time: 0.035676 Aug 29 23:56:53.949596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 306/593] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:53 2022] GET /compute/v2.1/servers/7ee8f86b-fd8a-4324-ae63-5329fe8fa4c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:53.974990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-263f5da9-6fca-4b0e-8a8c-4b8f20249109 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065438 Aug 29 23:56:53.976213 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 288/594] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:53 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:56:54.410461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:54.421563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.421960 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.422390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.437079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] Creating event network-changed:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:56:54.444637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b9c9e9e3-7d71-47e6-a239-3d121a4fa5bf req-7bdb502b-b077-4354-8f38-47049a780131 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037815 Aug 29 23:56:54.445302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 307/595] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:54.748393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:54.749163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:54.765435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.766452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.766594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.767262 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.773284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.774026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.911548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:54.927311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b37ba185-8af6-4b25-813a-6fecf171818e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1301 microversion: 2.1 time: 0.183843 Aug 29 23:56:54.928371 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 289/596] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:54 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1301 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:54.991890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:54.994382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:55.000983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.001475 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.001907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:55.002609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.003058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.003473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:55.036831 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9cd1572e-ff6e-4c85-b9f1-c9c98102dbdd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049450 Aug 29 23:56:55.037442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 308/597] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:54 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:55.977252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:55.978183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:55.988598 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.989095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.989532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:55.990245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.991223 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.992162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.051094 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:56.053987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:56.061933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.062420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.062852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.063554 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.064006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.064452 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.099108 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-eab3591b-b04f-440e-9fde-aa2558f3d734 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052385 Aug 29 23:56:56.117345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 309/598] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:56 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:56.233043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:56.233854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:56.240756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.241245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.241678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.242395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.242849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.243268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.249544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:56.264333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63bd1875-f49c-40f1-bb95-f9b7c78f9eee tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.300938 Aug 29 23:56:56.265315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 290/599] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:55 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:56.283896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:56.636807 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9851f616-3b74-43d0-91d8-bc9f0dadca3b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 204 len: 0 microversion: 2.20 time: 0.411302 Aug 29 23:56:56.637319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 310/600] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 23:56:56 2022] DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 23:56:56.644301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35389dd-c528-4d6d-8519-fdb7a2d94c2c", "tag": "ed6ca7d8-37df-4692-9d8b-45582a2ea5c7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:56.647269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:56.648534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:56.654956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.659939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.660100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.660236 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.660329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.660329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.660329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:56.660329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:56.660674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.668657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] Creating event network-changed:ed6ca7d8-37df-4692-9d8b-45582a2ea5c7 for instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c on hv-cinder-85504 Aug 29 23:56:56.674631 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-e3faf3ae-59f4-47b4-a3e3-bd2b819f1bb4 req-203ab403-e077-4ca6-954f-b694a6198c43 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034041 Aug 29 23:56:56.676074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 291/601] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:56.814840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:56.824662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:56.826130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:56.828217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d6fbf910-5642-4714-9369-8fd0fa2d11d3 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.185060 Aug 29 23:56:56.828217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 311/602] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:56 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:57.288005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:57.288752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:57.296919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.297444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.297887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.298627 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.299089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.299518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.447449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:57.455680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-71da6476-5e81-4e12-a95e-e60ce8469ce0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.172575 Aug 29 23:56:57.456311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 292/603] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:57 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:57.853440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:57.855316 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:57.862500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.862963 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.863393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.864111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.864623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.865047 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.030224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:58.032856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:58.041816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:58.043337 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:58.044613 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-23fe7409-978f-4f47-a582-e661234a5f5a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.195342 Aug 29 23:56:58.045181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 312/604] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:57 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:58.478511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:58.479706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:58.486947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:58.487481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:58.487921 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.488673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:58.489131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:58.489555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.645634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:58.654555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e6178af4-50b9-4bfa-a059-a841240effe5 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.180394 Aug 29 23:56:58.655166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 293/605] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:58 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:59.068184 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:59.068855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:59.076593 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.077122 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.077564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.078279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.078736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.079210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.230642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:59.240351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:59.241972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:59.243340 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-92472fed-2a0b-4191-85e9-cb178d197cab tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.179229 Aug 29 23:56:59.244103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 313/606] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:59 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:59.675984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:59.676648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:59.684113 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.684724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.685165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.685878 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.686357 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.686782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.834397 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:59.843511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b6639153-1f05-4768-a64a-4a40fdfa6a3b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.171890 Aug 29 23:56:59.844155 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 294/607] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:59 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:00.267795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:00.268435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:00.275275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:00.276040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:00.276537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:00.277319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:00.277788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:00.278274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:00.441258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:00.454697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:00.456957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:00.458373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b5342622-79f0-4e30-bdb9-6270ab6d888e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.194543 Aug 29 23:57:00.459676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 314/608] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:00 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:00.876023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:00.877237 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:00.891879 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=76 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:00.894507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:00.895034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:00.895724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:00.896669 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:00.897284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:00.897867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:01.053396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:01.061985 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c4ddb12b-b3f2-4d02-8216-bd06286986d3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.198859 Aug 29 23:57:01.062898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 295/609] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:00 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:01.484721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:01.486095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:01.488409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:01.489099 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=10 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:01.497787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:01.502996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:01.502996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:01.502996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:01.502996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:01.503479 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:01.751874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:01.760524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:01.762330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:01.763540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-83991624-d308-4fd0-a36b-d0dcb26bc06b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1722 microversion: 2.20 time: 0.283422 Aug 29 23:57:01.764222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 315/610] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:01 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:02.094877 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:02.095999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:02.100009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:02.106261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:02.106261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:02.106261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:02.106261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:02.109191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:02.109191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:02.160060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39819963-dd3d-4079-a0a1-d21a46d4a420", "name": "network-vif-deleted", "tag": "b8d16afd-dba0-4d77-93f1-1d3f97943c11"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:02.171660 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:02.172067 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:02.172768 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:02.189384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] Creating event network-vif-deleted:b8d16afd-dba0-4d77-93f1-1d3f97943c11 for instance 39819963-dd3d-4079-a0a1-d21a46d4a420 on hv-cinder-85504 Aug 29 23:57:02.196022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-7486b877-c6d2-49c9-918d-9cd056ec18a2 req-b27fa2ce-1cee-4e53-9cb0-e3627a81d3a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039099 Aug 29 23:57:02.197361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 316/611] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:02.310079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:02.319181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8f0dc9c1-5b90-434c-9b6b-187c5311cf7b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.228065 Aug 29 23:57:02.326725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 296/612] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:02 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:02.788153 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:02.788892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:02.791614 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:02.796535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:02.797020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:02.797520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:02.798220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:02.798673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:02.799093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:02.869591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:02.881504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:02.883795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:02.886773 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e0a38b6a-8a85-4883-84d4-f7b2bd3640c2 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1655 microversion: 2.20 time: 0.102532 Aug 29 23:57:02.887863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 317/613] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:02 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:03.343297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:03.343945 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:03.351441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:03.352095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:03.352684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:03.353532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:03.354221 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:03.354631 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:03.527625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:03.541401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70e7a3f3-977d-4667-b0ff-81bf6e9dc796 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.202492 Aug 29 23:57:03.542381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 297/614] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:03 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:03.923947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:03.924884 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:03.931860 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:03.932381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:03.932827 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:03.933532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:03.933995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:03.934456 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:03.969377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:03.969917 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:03.970358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:03.970807 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lazy-loading 'fault' on Instance uuid 39819963-dd3d-4079-a0a1-d21a46d4a420 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:04.030000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:04.047927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:04.050553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:04.052828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3523b54a-1c8b-416b-b455-33513f79ee7e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 200 len: 1370 microversion: 2.20 time: 0.132864 Aug 29 23:57:04.053724 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 318/615] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:03 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:04.563269 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:04.563901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:04.570627 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:04.571117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:04.571551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:04.572326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:04.572784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:04.573207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:04.713196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:04.721184 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f591c574-f176-4d03-b372-13b9658c9a07 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.161791 Aug 29 23:57:04.721765 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 298/616] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:04 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:05.091731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:05.092315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:05.098978 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:05.099470 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:05.099907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:05.100708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:05.101164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:05.101586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:05.116986 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 HTTP/1.1 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:57:05.117878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:57:05.120797 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '39819963-dd3d-4079-a0a1-d21a46d4a420'} Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:05.121765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:57:05.123383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:05.124976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:05.124976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2cbba4f0-184a-435c-9adb-de334e8ab266 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 404 len: 111 microversion: 2.20 time: 0.032848 Aug 29 23:57:05.124976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 319/617] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:05 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:57:05.128789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-660ebd4a-9306-4d57-ac33-61866c914423 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '.version_select at 0x7fd5a656b790>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:05.231496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-660ebd4a-9306-4d57-ac33-61866c914423 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826367998" status: 204 len: 0 microversion: 2.20 time: 0.106456 Aug 29 23:57:05.232125 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 299/618] 10.222.0.90 () {60 vars in 1262 bytes} [Mon Aug 29 23:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826367998 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:57:05.745193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:05.745912 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:05.752850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:05.753340 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:05.753801 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:05.754507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:05.755133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:05.755719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:05.968294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:05.976312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d7b19689-4155-491e-bd25-19b7b25ec6a1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.236267 Aug 29 23:57:05.976891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 320/619] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:05 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:06.247842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-37e7eb9b-48c6-4602-b248-aaf056fb5894 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: .version_select at 0x7fd5a65225e0>, body: {"keypair": {"name": "tempest-keypair-989366422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFvIAgbYdM9VYLuUaUwiAUZKp1qSRpJJzImyH9htX1Xjah/SvjGFOlvQJ51JJupoZnwutsj9j7baPG2KPlxUqkYtSMpZmtLEArunb9K5aUux5BwrVOcnrB638zIhhuStA=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:06.277336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-37e7eb9b-48c6-4602-b248-aaf056fb5894 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:06.283842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-37e7eb9b-48c6-4602-b248-aaf056fb5894 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for user 33926e50bce94a7e91fb2cd1a3071b73 and project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:06.368612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-37e7eb9b-48c6-4602-b248-aaf056fb5894 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.130401 Aug 29 23:57:06.369293 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 300/620] 10.222.0.90 () {62 vars in 1200 bytes} [Mon Aug 29 23:57:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 23:57:06.440213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35389dd-c528-4d6d-8519-fdb7a2d94c2c", "name": "network-vif-plugged", "status": "completed", "tag": "ed6ca7d8-37df-4692-9d8b-45582a2ea5c7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:06.450633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:06.451101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:06.451523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:06.464299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] Creating event network-vif-plugged:ed6ca7d8-37df-4692-9d8b-45582a2ea5c7 for instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c on hv-cinder-85504 Aug 29 23:57:06.469241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-4eec0d2d-74ab-4d99-914e-0c814ea0c0ce req-5fdad054-ce3e-46ef-af28-e2d957191a05 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032807 Aug 29 23:57:06.469841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 321/621] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:06.997104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:06.997714 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:07.003972 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:07.004613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:07.005058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:07.005745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:07.006205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:07.006630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:07.152656 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:07.160163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-94efb227-a871-4954-b452-5de855c7ffb3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.167315 Aug 29 23:57:07.160770 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 301/622] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:06 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:08.183864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:08.184691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:08.192079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:08.193113 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:08.193965 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:08.195308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:08.196156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:08.196950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:08.638566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:08.646653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c1bdd729-0f86-4261-b68f-7670be3395e8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.468318 Aug 29 23:57:08.647242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 322/623] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:08 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:09.227511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466284368", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a46036d-55d3-472c-985d-7d32e6afcac9"}], "security_groups": [{"name": "tempest-securitygroup--613294517"}], "key_name": "tempest-keypair-989366422", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:09.413782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] validate_networks() for [('7a46036d-55d3-472c-985d-7d32e6afcac9', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:57:09.671763 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:09.672979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:09.684116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.685048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.685838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.687123 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.687943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.688720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.953966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:09.971871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a400043a-416e-458d-bba2-e29c9322bcc0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.307548 Aug 29 23:57:09.972510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 323/624] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:09 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:10.077213 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:57:10.078002 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:57:10.078860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:57:10.079606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:57:10.080423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:57:10.095851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:10.096703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:10.097430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:10.098662 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:10.099441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:10.100196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:10.113401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:10.132918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:10.140821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Getting quotas for user 33926e50bce94a7e91fb2cd1a3071b73 and project 3beae764b5cb4dcd9f13e26878bbac48. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:10.161480 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:57:10.165382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:57:10.358839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e40b3dcb-f255-4ade-b6b0-b99b620d000f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.135262 Aug 29 23:57:10.359601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 302/625] 10.222.0.90 () {62 vars in 1188 bytes} [Mon Aug 29 23:57:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 23:57:10.371971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:10.372718 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:10.431015 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:10.445561 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:10.448417 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:10.450519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f5c24ba7-da89-4727-8c63-4504975240fa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1280 microversion: 2.20 time: 0.083749 Aug 29 23:57:10.451551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 324/626] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:10 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:10.993865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:10.994478 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:11.004541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.005057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.005501 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.006216 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.006677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.007106 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.154958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:11.163311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0595c449-2229-4f8e-83d3-bde325602a27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1366 microversion: 2.1 time: 0.173281 Aug 29 23:57:11.163889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 303/627] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:10 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:11.343994 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:11.346302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:11.353355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.358382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.358382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.358382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.358382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.358749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.390314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-964162cf-5374-410a-be2c-5bd5f77d24de tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050202 Aug 29 23:57:11.390885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 325/628] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:11 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:57:11.460869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:11.461477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:11.468981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.469473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.469910 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.470649 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.471104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.471539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.477614 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:11.478226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:11.485471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.485993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.486400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.490531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.490531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.490531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.502717 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:57:11.575014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:11.605917 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:11.607491 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:11.608708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-79376b2c-65a1-40f5-b5e5-0fd1a174f0f5 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1284 microversion: 2.20 time: 0.134923 Aug 29 23:57:11.609100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 326/629] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:11 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:12.046183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e56d99a-3e02-45fc-8950-74bf03db4bac tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 204 len: 0 microversion: 2.1 time: 0.589337 Aug 29 23:57:12.046787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 304/630] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:11 2022] DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:57:12.054943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:12.055553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:12.061777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.062262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.062701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.063398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.063858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.064312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.187704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:12.188447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:12.194857 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.195356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.195792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.196534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.197049 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.197472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.218214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.229320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-855e09ae-30e8-4303-869f-e0f480db7a97 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1672 microversion: 2.1 time: 0.177998 Aug 29 23:57:12.230396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 327/631] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:12 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:12.392291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.402838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2dd862fe-230b-41fe-9086-c785c0e11580 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1556 microversion: 2.1 time: 0.217956 Aug 29 23:57:12.402838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 305/632] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:12 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:12.422428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:12.423084 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:12.429648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.430133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.430569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.431269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.431727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.432208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.513670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8f005397-1ceb-4718-b094-8f33a4214d34 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095336 Aug 29 23:57:12.514238 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 328/633] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:57:12 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:12.640909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:12.641577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:12.648330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.648820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.649260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.649979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.650435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.650861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.716610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.725561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.727062 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.728118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e8595353-9d75-4620-884b-6c7c5a7f777c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1332 microversion: 2.20 time: 0.091215 Aug 29 23:57:12.728723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 306/634] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:12 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:13.272535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:13.273183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:13.280348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.280842 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.281282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.281992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.282483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.282902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.469505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:13.469505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4cb3c98e-bcef-4baa-b920-86973ad1e0cc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1672 microversion: 2.1 time: 0.194704 Aug 29 23:57:13.469505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 329/635] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:13 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:13.676373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35389dd-c528-4d6d-8519-fdb7a2d94c2c", "tag": "ed6ca7d8-37df-4692-9d8b-45582a2ea5c7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:13.690519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.690994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.691413 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.703894 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] Creating event network-changed:ed6ca7d8-37df-4692-9d8b-45582a2ea5c7 for instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c on hv-cinder-85504 Aug 29 23:57:13.709215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-96802f9a-f0a8-4375-bc2e-0250dde0ecd2 req-60650901-0fc9-4bda-b4ec-f411debc60d4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Aug 29 23:57:13.709816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 307/636] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:13.752357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:13.752969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:13.759086 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.759710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.760144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.761668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.762126 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.762547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.827911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:13.837292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:13.838886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:13.840324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cd72df7a-c3fb-408c-9699-87eabaea4037 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1332 microversion: 2.20 time: 0.092022 Aug 29 23:57:13.840897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 330/637] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:13 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:14.489249 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:14.490398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:14.497343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.497855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.498291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:14.499202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.499895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.500549 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:14.748344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:14.758766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-021349f2-edc0-4515-a543-ac9ce2aeca76 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1672 microversion: 2.1 time: 0.274073 Aug 29 23:57:14.759829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 308/638] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:14 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:14.867064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:14.867922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:14.888763 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.889423 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.890058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:14.890925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.891481 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.896509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.044840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:15.060960 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:15.066163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:15.073801 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1be29900-892a-4d90-a466-b2072f14b4ef tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1340 microversion: 2.20 time: 0.211326 Aug 29 23:57:15.074901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 331/639] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:14 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:15.786313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3de91e-440c-4c11-97f0-8cc634192f45", "name": "network-vif-deleted", "tag": "5a748e41-64a4-4228-b0c8-40ef6e76caf4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:15.799201 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:15.799929 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.800360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:15.800634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.801162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.813043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.813961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.814559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.815472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.816314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.817046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.819358 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] Creating event network-vif-deleted:5a748e41-64a4-4228-b0c8-40ef6e76caf4 for instance 6d3de91e-440c-4c11-97f0-8cc634192f45 on hv-cinder-85504 Aug 29 23:57:15.825790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-1995fae4-e7c0-41ef-b8ea-48cdc8edfef0 req-351d74b3-0854-4c37-9428-2a5ee1edc2a1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043519 Aug 29 23:57:15.827230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 309/640] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:15.839816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:15.923870 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:15.935646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6fa1ede8-ac0f-49f9-9cde-fc801b35897a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1605 microversion: 2.1 time: 0.141313 Aug 29 23:57:15.936915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 332/641] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:15 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:16.099264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:16.099975 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:16.107243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:16.107740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:16.108197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:16.108914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:16.109377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:16.109801 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:16.350985 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:16.365662 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:16.367150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:16.375685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-070d7c4e-da4d-4db2-9544-6087ac68268e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.273998 Aug 29 23:57:16.376916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 310/642] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:16 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:16.961514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:16.962183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:16.970553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:16.971057 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:16.973588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:16.974379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:16.974863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:16.975297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.011345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.011838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.012331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.012789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lazy-loading 'fault' on Instance uuid 6d3de91e-440c-4c11-97f0-8cc634192f45 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:17.054487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:17.064940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f0bd421f-33e0-41fc-8f07-c52600749e3b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 200 len: 1327 microversion: 2.1 time: 0.107160 Aug 29 23:57:17.065451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 333/643] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:16 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:17.403822 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:17.405170 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:17.412137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.412655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.413114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.413804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.414257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.415015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.437410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:17.451095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.451095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.451095 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.462611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] Creating event network-changed:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:57:17.469765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-21f88ca6-7c43-4536-986a-53d9193ea39f req-566e32dd-74b5-4bc9-9500-2d7d28b99617 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Aug 29 23:57:17.470834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 334/644] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:17.700903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:17.710102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:17.711550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:17.712795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bf53e768-6416-4b09-82df-db366163ec0c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.314388 Aug 29 23:57:17.713854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 311/645] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:17 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:18.089021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:18.090110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:18.096863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.097347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.097777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.098477 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.098918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.099331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.114718 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 HTTP/1.1 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:57:18.116395 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:57:18.118063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '6d3de91e-440c-4c11-97f0-8cc634192f45'} Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:18.118944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:57:18.120991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:18.122392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:18.122392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c460595f-acad-484e-be1c-b3524f86bab7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 404 len: 111 microversion: 2.1 time: 0.034277 Aug 29 23:57:18.122392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 335/646] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:18 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:18.128737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cb54286e-23ea-45d4-a8e5-e3ad98cdf367 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '.version_select at 0x7fd5a6541c10>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:18.240039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cb54286e-23ea-45d4-a8e5-e3ad98cdf367 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544672288" status: 202 len: 0 microversion: 2.1 time: 0.112503 Aug 29 23:57:18.240039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 312/647] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544672288 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:57:18.740539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:18.741138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:18.747852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.748332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.748778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.749496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.749955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.750401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.946553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:18.957983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:18.959708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:18.960900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-657f4f6a-8047-4387-bfdf-fa7a9a5b1a8a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.224739 Aug 29 23:57:18.971361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 336/648] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:18 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:19.214393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-671f1604-d818-43e7-b564-31a807d45df5 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: .version_select at 0x7fd5a6796550>, body: {"keypair": {"name": "tempest-keypair-453528483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA/FyUm8Y/MUp9bEXIJ2qWw7CLxB0e3jBeFqpBwZw7+BD/0JYzPv/H5zE63Vw6iYOtSOTl0ec+WaKIcBTRkLNF38CrrvoXII9d0HuW2mxsCyqANWbdCp6ls6Yljmsb8Aw=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:19.238380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-671f1604-d818-43e7-b564-31a807d45df5 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for project 4b68600b8657473eb43d16098bbcacf6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:19.244584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-671f1604-d818-43e7-b564-31a807d45df5 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for user 9b06987b00c245c0b8a9f3f4bb977bb1 and project 4b68600b8657473eb43d16098bbcacf6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:19.357024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-671f1604-d818-43e7-b564-31a807d45df5 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150853 Aug 29 23:57:19.357569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 313/649] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:57:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:19.989862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:19.991019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:20.002631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:20.003510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:20.004343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:20.005619 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:20.006457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:20.007222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:20.206966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:20.215441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:20.217933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:20.219062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1f717097-a972-4e7d-82ee-154080f1ae60 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.238420 Aug 29 23:57:20.219625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 337/650] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:19 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:21.248097 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:21.249370 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:21.254653 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:21.261477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.262017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.268074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.268074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.268074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.268074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.508473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:21.517180 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:21.518661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:21.520007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2543afd2-7dfd-45e8-b34f-a721a5cb5e6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.281021 Aug 29 23:57:21.520613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 314/651] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:21 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:21.924394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-555212393", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9cdff2-05de-4391-b19a-4c2f9845a0aa"}], "security_groups": [{"name": "tempest-securitygroup--1336308140"}], "key_name": "tempest-keypair-453528483", "user_data": "}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:21.932754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:22.047336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] validate_networks() for [('4c9cdff2-05de-4391-b19a-4c2f9845a0aa', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:57:22.449434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:57:22.450167 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:57:22.450743 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:57:22.451155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:57:22.451571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:57:22.461457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:22.461937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:22.462373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:22.463116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:22.463574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:22.464002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:22.485914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for project 4b68600b8657473eb43d16098bbcacf6. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:22.489271 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Getting quotas for user 9b06987b00c245c0b8a9f3f4bb977bb1 and project 4b68600b8657473eb43d16098bbcacf6. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:22.501646 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:57:22.504016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:57:22.545319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:22.545927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:22.553253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:22.553734 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:22.554181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:22.554872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:22.555322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:22.555751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:22.688521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-12a7f38e-8e7b-48fc-baf2-b176fd729b61 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.768234 Aug 29 23:57:22.689244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 338/652] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:57:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:57:22.693330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:22.700291 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9919fc42-07b6-43a2-80ea-5ec03a2def69 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:22.700952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9919fc42-07b6-43a2-80ea-5ec03a2def69 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:22.709073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:22.710795 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:22.711973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-12165fd5-3508-4324-b869-227278261c3e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.171162 Aug 29 23:57:22.714014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 315/653] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:22 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:22.760592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9919fc42-07b6-43a2-80ea-5ec03a2def69 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:22.769472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9919fc42-07b6-43a2-80ea-5ec03a2def69 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1236 microversion: 2.1 time: 0.072921 Aug 29 23:57:22.778948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 339/654] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:22 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:23.352951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "name": "network-vif-plugged", "status": "completed", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:23.363190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.363964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.364599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.378384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] Creating event network-vif-plugged:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:57:23.384817 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d56b52ba-b450-47ca-afcf-6d476e1aa0c4 req-b890fc74-302d-49d8-a1a8-6bb09c9f577c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Aug 29 23:57:23.385519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 316/655] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:23.745972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:23.747185 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:23.759129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.759716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.760252 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.761151 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.761935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.768320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.794666 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:23.796152 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:23.804936 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.805500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.806104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.807244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.807777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.808226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:24.159241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:24.176744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6e51f2db-8ed3-44a7-81c7-14c09b16c14e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1240 microversion: 2.1 time: 0.388908 Aug 29 23:57:24.177357 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 317/656] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:23 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1240 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:24.260757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:24.269549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:24.270990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:24.272102 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-add9ecda-3a65-4eea-877c-019e4f194bcc tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.530659 Aug 29 23:57:24.272698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 340/657] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:23 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:25.198049 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:25.198641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.206587 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.207068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.207495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.208199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.208666 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.209089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.277699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:25.286405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7979ce67-2277-43be-90ae-7306bab66bb4 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1288 microversion: 2.1 time: 0.092049 Aug 29 23:57:25.286955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 318/658] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:25 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:25.296145 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:25.297117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.303553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.304053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.304521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.305255 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.305705 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.306131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.476366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:25.485856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:25.487420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:25.488574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b665076b-1af7-49ee-8728-f1682d9bdb0e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1405 microversion: 2.20 time: 0.197221 Aug 29 23:57:25.489143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 341/659] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:25 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:26.308497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:26.309106 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:26.316976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.317463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.317896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.318686 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.319137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.319558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.400517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.409346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b109b080-a25e-4fc1-9c75-b9b11fab12eb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1306 microversion: 2.1 time: 0.104630 Aug 29 23:57:26.409850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 319/660] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:26 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:26.521100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:26.521867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:26.530858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.531404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.531956 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.532794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.533476 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.534149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.776161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.784921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.786461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.787626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ffa0bf57-b3b1-416f-923c-085b1158159f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1598 microversion: 2.20 time: 0.273104 Aug 29 23:57:26.788268 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 342/661] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:26 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1598 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:26.815366 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:26.815886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:26.821950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.822429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.822857 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.823536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.823987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.824444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.917154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a83ffcba-963a-44f3-af17-aa79c0c8c874 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105722 Aug 29 23:57:26.917820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 320/662] 10.222.0.90 () {60 vars in 1316 bytes} [Mon Aug 29 23:57:26 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:57:27.435411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:27.436020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:27.442405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.442897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.443355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:27.444068 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.444541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.445163 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:27.655121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:27.663054 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7ddb4914-733d-4137-af34-41c2500eedc6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.231737 Aug 29 23:57:27.663655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 343/663] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:27 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:28.027235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:28.038304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.038785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.039254 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.053671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] Creating event network-changed:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:57:28.059378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-9d86c8a0-7dcb-4744-bba8-47a997aea87c req-b2206c9f-6c51-4b54-9f7a-b75c93a4b3e7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036153 Aug 29 23:57:28.060095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 321/664] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:28.084800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ca1939-82ad-4ef4-a1b5-ba654f65c022", "tag": "ef911d73-328b-439d-a53e-4fec1630c68b"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:28.104039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.104940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.105721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.131250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] Creating event network-changed:ef911d73-328b-439d-a53e-4fec1630c68b for instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 on hv-cinder-85504 Aug 29 23:57:28.141111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-d8ec75e8-ca84-4c9e-96ed-79bbe66fe37e req-4770b550-509c-4539-8986-7383e136f4a6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062035 Aug 29 23:57:28.143760 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 344/665] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:28.698623 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:28.699316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:28.702865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:28.708400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.708888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.713353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.713353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.713353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.713353 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.853005 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:28.855402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:28.863413 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-64e6057f-60aa-4156-8034-c44106560c89 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.168841 Aug 29 23:57:28.864248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 322/666] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:28 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:29.886892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:29.887640 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:29.894471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.894983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.895470 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.896214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.896671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.897104 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.038140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:30.046594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1eae1ad6-e492-4410-acb6-3b2ebbaa7acd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.164952 Aug 29 23:57:30.047181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 345/667] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:29 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:30.269095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:30.270177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:30.273473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=14 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:30.280958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.282144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.282755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.283871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.284672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.285429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.396190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'services' on Instance uuid 566e2dc8-23df-460a-bc9e-6d686006f9ef {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:30.670545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dfd9460a-d2b1-4473-b995-87dfedfd3cc0 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments/5fc95b4a-9bbd-4b03-ab54-7308f3ed69af" status: 202 len: 0 microversion: 2.1 time: 0.406053 Aug 29 23:57:30.674319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 323/668] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:57:30 2022] DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments/5fc95b4a-9bbd-4b03-ab54-7308f3ed69af => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:57:30.680041 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:30.682394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:30.690508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.691000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.691469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.692199 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.692690 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.693119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.728833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a614114c-8d87-4753-bcbe-279ae1e9d794 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052670 Aug 29 23:57:30.729770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 346/669] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:30 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:31.069007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:31.069699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:31.076769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.077257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.077684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.078378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.078826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.079245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.235829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:31.244893 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e0852d11-a3c9-42ea-b180-75009fe0e33c tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.180388 Aug 29 23:57:31.245497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 324/670] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:31 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:31.741597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:31.743817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:31.751152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.751670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.752124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.752859 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.753318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.753749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.787513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5ca9d4a9-cdd0-495f-805b-720c4de81ddf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049770 Aug 29 23:57:31.788119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 347/671] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:31 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:32.270808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:32.271417 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:32.278031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.278799 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.279059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:32.279754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.280244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.280671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:32.416675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:32.425065 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e409edd-0f71-4f77-80a1-3aec5241c649 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.158191 Aug 29 23:57:32.425629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 325/672] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:32 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:32.801651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:32.803373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=8 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:32.999144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:33.001788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:33.009247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.009742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.011639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.011639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.011639 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.011925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.046435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-66d874f5-e64e-4704-898f-9e24184d0829 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249425 Aug 29 23:57:33.047023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 348/673] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:32 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:33.473718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:33.473718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:33.473718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.473718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.474671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.474671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.474671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.474671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.719769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:33.729521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d383e139-2456-428b-a472-4f85495e7c17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.287551 Aug 29 23:57:33.730025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 326/674] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:33 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:34.059214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:34.061495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:34.068149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.068680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.069226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.069944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.070401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.070823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.125011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b1cccf31-0b03-459c-997a-237fedcab9b7 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068965 Aug 29 23:57:34.126287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 349/675] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:34 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:34.753116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:34.753736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:34.760335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.760818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.761247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.761941 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.762982 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.763404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.906888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:34.914418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-40300a4a-06da-467c-abe3-994725ddcb6d tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.165155 Aug 29 23:57:34.914984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 327/676] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:34 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:35.138172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:35.140448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:35.147150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.147632 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.148060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.148773 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.149224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.149666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.181144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-15c2140a-9d4a-4695-8a3e-ec1b3c7f0ccd tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Aug 29 23:57:35.181698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 350/677] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:35 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:35.938152 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:35.938958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:35.945264 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.945756 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.946193 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.947280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.947593 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.949740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.100842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:36.112458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1bbd4727-b3ae-4a0c-b0aa-8d84a377e14f tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.179747 Aug 29 23:57:36.113200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 328/678] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:35 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:36.194409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:36.196792 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:36.199360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:36.205695 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.206449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.206996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.207717 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.208258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.208694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.241298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-add8816c-acf4-4ed4-acfe-668c0c44490b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050990 Aug 29 23:57:36.241885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 351/679] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:36 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:57:36.335609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:36.336111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:36.343049 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.343547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.343985 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.345504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.345504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.345678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.374309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:57:36.670171 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-58af0ed0-b4f9-49b6-bf33-f7bba5ad8b8e tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 204 len: 0 microversion: 2.1 time: 0.338371 Aug 29 23:57:36.670818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 329/680] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:36 2022] DELETE /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:57:36.680756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:36.681440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:36.691508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.692008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.692609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.693343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.693811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.694242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.713830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:36.928329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:36.937028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-423c3c05-3fa8-4ec1-add2-8811cc5a5d11 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1689 microversion: 2.1 time: 0.261375 Aug 29 23:57:36.937620 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 352/681] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:36 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:37.282509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:37.283215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:37.291727 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.292245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.292685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:37.293405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.293860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.294288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:37.454732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:37.463441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-56a13621-f025-4cc1-8c7e-19eb12bcfcd6 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.332151 Aug 29 23:57:37.464032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 330/682] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:37 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:37.958322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:37.959133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:37.966790 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.967294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.967738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:37.968490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.968953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.969607 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:38.117411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:38.126018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ebba01de-bc04-47c8-bd57-6d90dbffc98c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1689 microversion: 2.1 time: 0.171785 Aug 29 23:57:38.126606 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 353/683] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:37 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:38.487279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:38.487813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:38.494902 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:38.495412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:38.495850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:38.497456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:38.497918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:38.498531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:38.672688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:38.686655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7f1b6c24-7f31-427c-9733-e833964bf749 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.203064 Aug 29 23:57:38.688470 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 331/684] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:38 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:38.735277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ca1939-82ad-4ef4-a1b5-ba654f65c022", "name": "network-vif-plugged", "status": "completed", "tag": "ef911d73-328b-439d-a53e-4fec1630c68b"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:38.747039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:38.747539 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:38.747964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:38.759945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] Creating event network-vif-plugged:ef911d73-328b-439d-a53e-4fec1630c68b for instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 on hv-cinder-85504 Aug 29 23:57:38.765544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-aeb7f726-f9d9-4e5d-a6db-fca01efd6775 req-62fdfeb8-e55f-4c27-b0b5-775ec75441e4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Aug 29 23:57:38.768383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 354/685] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:39.147826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:39.148500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:39.155653 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.156157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.156639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.157359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.157818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.158248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.315543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:39.326908 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1e88ba92-1862-4d22-a1e9-7814d73dabf2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1689 microversion: 2.1 time: 0.182574 Aug 29 23:57:39.328158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 332/686] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:39 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:39.712719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:39.713327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:39.721018 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.721514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.721950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.722663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.723119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.723591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.876447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:39.886850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-69e0d36f-5a73-4448-8778-3b8daf400b29 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.178687 Aug 29 23:57:39.888105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 355/687] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:39 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:40.350347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:40.350911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:40.359267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.359764 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.362990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:40.362990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.362990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.362990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:40.646208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:40.654096 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-225e2688-f52a-4922-b331-f7f454314fdf tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1689 microversion: 2.1 time: 0.307553 Aug 29 23:57:40.655875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 333/688] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:40 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1689 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:40.910803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:40.911502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:40.920039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.922645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.922645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:40.922645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.922645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.923576 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.153203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:41.166007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f0339c22-faef-4eda-ab73-0116dea7aa2a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.259198 Aug 29 23:57:41.166787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 356/689] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:40 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:41.421140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566e2dc8-23df-460a-bc9e-6d686006f9ef", "name": "network-vif-deleted", "tag": "02e49e4b-817d-47fa-9692-a891d61a7f03"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:41.432480 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:41.439904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:41.439904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.446506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] Creating event network-vif-deleted:02e49e4b-817d-47fa-9692-a891d61a7f03 for instance 566e2dc8-23df-460a-bc9e-6d686006f9ef on hv-cinder-85504 Aug 29 23:57:41.452550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-3667618b-ee7f-4594-877b-df7cb96a5b05 req-b6c84c45-b2e3-4ca3-bbae-d9f484fa5816 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035690 Aug 29 23:57:41.453545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 334/690] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:41.679213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:41.679841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:41.686746 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:41.687241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:41.687709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.688500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:41.689259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:41.689432 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.763051 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:41.776774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3fd1e087-3726-489f-a2ba-cca120b46768 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1622 microversion: 2.1 time: 0.102085 Aug 29 23:57:41.780765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 357/691] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:41 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1622 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:42.188490 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:42.189881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:42.196931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:42.197767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:42.198373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:42.199401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:42.200277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:42.200970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:42.366403 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:42.375191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-925ee8c2-991f-4fdb-aae1-0aa473621744 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1362 microversion: 2.1 time: 0.191273 Aug 29 23:57:42.375862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 335/692] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:42 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:42.804757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:42.807891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:42.812641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:42.813135 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:42.813577 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:42.814403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:42.814875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:42.815300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:42.858118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:42.858612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:42.859071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:42.859558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'fault' on Instance uuid 566e2dc8-23df-460a-bc9e-6d686006f9ef {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:42.901735 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:42.913516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9cca10ce-5344-4d39-bf44-4593ded183bb tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 200 len: 1336 microversion: 2.1 time: 0.112614 Aug 29 23:57:42.914392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 358/693] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:42 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:43.396585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:43.397278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:43.404274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.407422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.407422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.407422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.407422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.407775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.543852 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:43.552225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-22bafc6b-f607-46d6-a134-022c2a4e615b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1548 microversion: 2.1 time: 0.159353 Aug 29 23:57:43.552819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 336/694] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:43 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:43.577825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:43.578398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:43.585246 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.587406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.587406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.587406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.587406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.587890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.673353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-560358be-1de8-4a38-a8c0-963d329c7d17 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100164 Aug 29 23:57:43.673954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 359/695] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:57:43 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:43.940315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:43.940971 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 566e2dc8-23df-460a-bc9e-6d686006f9ef] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:43.947412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.947907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.948382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.949088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.950082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.950513 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.966612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] HTTP exception thrown: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Request method failure captured: Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef HTTP/1.1 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFAIYASVtzH8JeVcHwa69nydl0Tv19W5_1V5CSGCBW2E6APPLk4OonL7nP5kECIVsOFEF893nArkpLrzBaoM5X9ifoM9ftGNiJFK0-wrERv83WNqg_QY270UP0YnhIyB4_DH7oiNKu7QKczKs6G0LKa6J9fMywaIJzHCkro-Bcy0i0 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:57:43.968311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dc817de5d4ef4812a2fee6ebe0895889", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}] Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 57998546e6a64d42ba3ded9f3267e6af Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. Aug 29 23:57:43.969896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '566e2dc8-23df-460a-bc9e-6d686006f9ef'} Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:43.970844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. Aug 29 23:57:43.972552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:57:43.974069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Returning 404 to user: Instance 566e2dc8-23df-460a-bc9e-6d686006f9ef could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:43.974069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-96a39e6b-8d4e-4334-b8f0-bd8367637e4f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef" status: 404 len: 111 microversion: 2.1 time: 0.033594 Aug 29 23:57:43.979245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5236256f-6619-4e3e-928d-d343394c72fe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '.version_select at 0x7fd5a63af820>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:43.983515 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 337/696] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:43 2022] GET /compute/v2.1/servers/566e2dc8-23df-460a-bc9e-6d686006f9ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:44.093368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5236256f-6619-4e3e-928d-d343394c72fe tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425097786" status: 202 len: 0 microversion: 2.1 time: 0.118636 Aug 29 23:57:44.094032 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 360/697] 10.222.0.90 () {58 vars in 1221 bytes} [Mon Aug 29 23:57:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425097786 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:57:45.413418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ca1939-82ad-4ef4-a1b5-ba654f65c022", "tag": "ef911d73-328b-439d-a53e-4fec1630c68b"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:45.444948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:45.451253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:45.451253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:45.473078 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] Creating event network-changed:ef911d73-328b-439d-a53e-4fec1630c68b for instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 on hv-cinder-85504 Aug 29 23:57:45.482346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d47f9dad-1f8c-4850-8b65-4fdf942804ce req-6628ba44-084a-495b-8a63-a2921d61494c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075000 Aug 29 23:57:45.483712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 338/698] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:48.375849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:48.376732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:48.383185 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.383598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.384036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.384835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.385299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.385727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.415274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:57:48.714546 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ef1b5de2-7b69-4f76-941d-2245ebcd9b8b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 204 len: 0 microversion: 2.1 time: 0.343246 Aug 29 23:57:48.715844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 361/699] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:48 2022] DELETE /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:57:48.726540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:48.727290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:48.735333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.736036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.736830 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.738118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.738630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.739132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.743318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:48.896541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:48.907321 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e18d729f-ef8d-4e81-b88c-d7bfd0faf579 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1508 microversion: 2.1 time: 0.186502 Aug 29 23:57:48.908110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 339/700] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:48 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:49.937684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.938392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:49.945529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:49.946013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:49.946445 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:49.947147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:49.947597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:49.948021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:50.107665 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:50.120724 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a2e6dc9f-d06b-4558-9204-7322fbacc33d tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1508 microversion: 2.1 time: 0.187249 Aug 29 23:57:50.121399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 362/701] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:51.146719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:51.147815 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:51.162338 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:51.163310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:51.164120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:51.169295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:51.169295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:51.169295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:51.447357 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:51.457885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3c50521a-50a7-48df-be3d-63f653290ea2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1508 microversion: 2.1 time: 0.318408 Aug 29 23:57:51.465718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 340/702] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:51 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:51.957964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022f6c97-74d7-4317-b679-3fb2dad0a739", "name": "network-vif-deleted", "tag": "59f1d716-7a45-4a0d-8eb0-20b9102bfd16"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:51.974044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:51.974302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:51.974731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:51.989494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] Creating event network-vif-deleted:59f1d716-7a45-4a0d-8eb0-20b9102bfd16 for instance 022f6c97-74d7-4317-b679-3fb2dad0a739 on hv-cinder-85504 Aug 29 23:57:51.994391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-167ab473-8ce7-4cda-bb77-89f70963c3f7 req-25e200fb-5160-44ba-8aec-2e0c0af41f1f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040589 Aug 29 23:57:51.995006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 363/703] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:52.493290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:52.494404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:52.503456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:52.504014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:52.504555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:52.505673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:52.506263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:52.506991 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:52.552792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:52.553157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:52.553554 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:52.553844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'fault' on Instance uuid 022f6c97-74d7-4317-b679-3fb2dad0a739 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:52.623046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:52.631541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9669e4a6-ec32-4ba0-a88b-791aaf79c057 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 200 len: 1312 microversion: 2.1 time: 0.142237 Aug 29 23:57:52.632143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 341/704] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:52 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:53.662701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:53.663824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 022f6c97-74d7-4317-b679-3fb2dad0a739] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:53.671009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.671508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.671954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.672707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.673164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.673600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.688915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] HTTP exception thrown: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Request method failure captured: Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 HTTP/1.1 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFAIYASVtzH8JeVcHwa69nydl0Tv19W5_1V5CSGCBW2E6APPLk4OonL7nP5kECIVsOFEF893nArkpLrzBaoM5X9ifoM9ftGNiJFK0-wrERv83WNqg_QY270UP0YnhIyB4_DH7oiNKu7QKczKs6G0LKa6J9fMywaIJzHCkro-Bcy0i0 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:57:53.690630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dc817de5d4ef4812a2fee6ebe0895889", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}] Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 57998546e6a64d42ba3ded9f3267e6af Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. Aug 29 23:57:53.692902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '022f6c97-74d7-4317-b679-3fb2dad0a739'} Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:53.694009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. Aug 29 23:57:53.695343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:57:53.697119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Returning 404 to user: Instance 022f6c97-74d7-4317-b679-3fb2dad0a739 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:53.697119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-889945f3-96ee-400b-a2b7-a5af7c3cd6f2 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739" status: 404 len: 111 microversion: 2.1 time: 0.035642 Aug 29 23:57:53.697119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 364/705] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:53 2022] GET /compute/v2.1/servers/022f6c97-74d7-4317-b679-3fb2dad0a739 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:57:53.702615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:53.703232 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:53.710156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.710634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.711056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.711749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.712215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.712636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.747287 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:57:54.063689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3e915e4f-e9bf-402c-b3cb-d83e78d2370f tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "DELETE /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 204 len: 0 microversion: 2.1 time: 0.365272 Aug 29 23:57:54.064335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 342/706] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:53 2022] DELETE /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:57:54.077865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:54.078578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:54.085588 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:54.086121 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:54.086569 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:54.087292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:54.087758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:54.088202 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:54.271891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:54.280103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bc34c2c6-b6bc-4a8c-a24e-04789fe9f690 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.206742 Aug 29 23:57:54.280751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 365/707] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:54 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:55.303498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:55.304387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:55.311412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:55.311903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:55.312388 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:55.313107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:55.313565 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:55.313992 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:55.493724 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:55.503943 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-37d03556-6f3f-4964-acb7-9a73af974c1b tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.204937 Aug 29 23:57:55.504654 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 343/708] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:55 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:56.532203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:56.532789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:56.539931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:56.548097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:56.548097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:56.548097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:56.548097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:56.548823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:56.691853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:56.700729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f44fea2d-6a09-4aaa-8dbc-afab08e11c24 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.173516 Aug 29 23:57:56.701318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 366/709] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:56 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:57.726460 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:57.727406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:57.736204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:57.736820 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:57.737319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:57.738190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:57.738720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:57.739230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:57.993767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:58.010551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-15f83ced-274b-435a-be3e-e3e983de22a8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1520 microversion: 2.1 time: 0.288714 Aug 29 23:57:58.011389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 344/710] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:57 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:58.344011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c9c11e-d575-4b60-be05-fe0a27272eac", "name": "network-vif-deleted", "tag": "1994af96-ee92-46f3-8bd5-3d9a397cf396"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:58.357244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:58.357720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:58.358149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:58.371279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] Creating event network-vif-deleted:1994af96-ee92-46f3-8bd5-3d9a397cf396 for instance 94c9c11e-d575-4b60-be05-fe0a27272eac on hv-cinder-85504 Aug 29 23:57:58.377323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-2da55f28-d24f-47bf-b57d-d1aa3fe9cf5f req-205dd22b-449b-4001-8286-302a42b55d66 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037000 Aug 29 23:57:58.378012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 367/711] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:59.005749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:59.006550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:59.017179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.018045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.018825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.020107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.021060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.021742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.049959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:59.050786 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:59.060413 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.061002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.061504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.062344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.062875 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.063364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.073859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dc7e1574-6519-40a2-94a4-1d6e67b0450a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/ips" status: 200 len: 149 microversion: 2.1 time: 0.400904 Aug 29 23:57:59.076472 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 345/712] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:57:58 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/ips => generated 149 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:59.110250 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.111110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.111881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.112675 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lazy-loading 'fault' on Instance uuid 94c9c11e-d575-4b60-be05-fe0a27272eac {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:59.174336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57998546e6a64d42ba3ded9f3267e6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc817de5d4ef4812a2fee6ebe0895889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:59.182551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0ea74f98-7cf6-4a87-9d5a-80e57d30a1c8 tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 200 len: 1311 microversion: 2.1 time: 0.140047 Aug 29 23:57:59.183148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 368/713] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:59 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:00.220546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:00.221568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] [instance: 94c9c11e-d575-4b60-be05-fe0a27272eac] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:00.229579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.230207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.231414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:00.232292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.232872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.233423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:00.251604 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] HTTP exception thrown: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Request method failure captured: Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac HTTP/1.1 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFAIYASVtzH8JeVcHwa69nydl0Tv19W5_1V5CSGCBW2E6APPLk4OonL7nP5kECIVsOFEF893nArkpLrzBaoM5X9ifoM9ftGNiJFK0-wrERv83WNqg_QY270UP0YnhIyB4_DH7oiNKu7QKczKs6G0LKa6J9fMywaIJzHCkro-Bcy0i0 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:58:00.253824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dc817de5d4ef4812a2fee6ebe0895889", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dc817de5d4ef4812a2fee6ebe0895889"}]}] Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: dc817de5d4ef4812a2fee6ebe0895889 Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2111062828 Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 57998546e6a64d42ba3ded9f3267e6af Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2111062828-project Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. Aug 29 23:58:00.256522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '94c9c11e-d575-4b60-be05-fe0a27272eac'} Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:00.267411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. Aug 29 23:58:00.271018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:00.274665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] Returning 404 to user: Instance 94c9c11e-d575-4b60-be05-fe0a27272eac could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:00.274665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aa4dcf81-6b9e-40ad-8600-bab2bf1d6e8c tempest-ServerRescueNegativeTestJSON-2111062828 tempest-ServerRescueNegativeTestJSON-2111062828-project] 10.222.0.90 "GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac" status: 404 len: 111 microversion: 2.1 time: 0.039086 Aug 29 23:58:00.274665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 346/714] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:00 2022] GET /compute/v2.1/servers/94c9c11e-d575-4b60-be05-fe0a27272eac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:58:00.837273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1abe417e-3dbd-42b2-91a4-c258ee4af948"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:00.841583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:00.850272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.850916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.851399 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:00.852408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.852955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.853535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:01.549638 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:01.759321 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d80276b2-17be-41c7-aefa-649ac7a67030 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927229 Aug 29 23:58:01.760680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 369/715] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:58:00 2022] POST /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:07.474245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-afb424ef-bd25-4445-8b9a-a7730d27538d tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Action: 'create', calling method: .version_select at 0x7fd5a6664280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173554078", "metadata": {"Type": "work"}}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-afb424ef-bd25-4445-8b9a-a7730d27538d tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 122 Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:58:07.487098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173554078", "metadata": {"Type": "work"}}} Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:58:07.488825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1173554078', 'metadata': {'Type': 'work'}}}} Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.489738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:58:07.491575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:58:07.493116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:58:07.493116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.493116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-afb424ef-bd25-4445-8b9a-a7730d27538d tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.493116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-afb424ef-bd25-4445-8b9a-a7730d27538d tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149551 Aug 29 23:58:07.493116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 347/716] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 23:58:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:58:07.501533 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-74717516-f191-4605-a94f-04aafa85231f tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Action: 'create', calling method: .version_select at 0x7fd5a63c1940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-859509976", "metadata": {"Type": "work"}}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-74717516-f191-4605-a94f-04aafa85231f tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 119 Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:58:07.506404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-859509976", "metadata": {"Type": "work"}}} Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: Aug 29 23:58:07.507941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-859509976', 'metadata': {'Type': 'work'}}}} Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi '0' Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.509045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:58:07.510580 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:58:07.513927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:58:07.513927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.513927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-74717516-f191-4605-a94f-04aafa85231f tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.513927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-74717516-f191-4605-a94f-04aafa85231f tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012288 Aug 29 23:58:07.513927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 370/717] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 23:58:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:58:07.519483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8107830f-5323-406f-9651-da50151b05a7 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Action: 'create', calling method: .version_select at 0x7fd5a648e670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1008108306", "metadata": {"Type": "work"}}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8107830f-5323-406f-9651-da50151b05a7 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 119 Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:58:07.524109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1008108306", "metadata": {"Type": "work"}}} Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:58:07.525967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1008108306', 'metadata': {'Type': 'work'}}}} Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi '' Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.527639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:58:07.529231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:58:07.530746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:58:07.530746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.530746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8107830f-5323-406f-9651-da50151b05a7 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.530746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8107830f-5323-406f-9651-da50151b05a7 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009988 Aug 29 23:58:07.530746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 348/718] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 23:58:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:58:07.537325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d65ef8e-fee3-4f2f-8e6e-eea0c15e8439 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Calling method '.version_select at 0x7fd5a653af70>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:07.566418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-2d65ef8e-fee3-4f2f-8e6e-eea0c15e8439 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] HTTP exception thrown: Volume tempest-invalid-2074798960 could not be found. Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d65ef8e-fee3-4f2f-8e6e-eea0c15e8439 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2074798960 HTTP/1.1 Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:58:07.569758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Volume tempest-invalid-2074798960 could not be found. Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'tempest-invalid-2074798960'} Aug 29 23:58:07.571331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2074798960 could not be found. (HTTP 404) (Request-ID: req-fafa892d-fb8e-42b7-9703-48a5f5b12149) Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.572624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:58:07.574544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2074798960 could not be found. Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:07.575782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2074798960 could not be found. Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2074798960 could not be found. Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d65ef8e-fee3-4f2f-8e6e-eea0c15e8439 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 404 to user: Volume tempest-invalid-2074798960 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2d65ef8e-fee3-4f2f-8e6e-eea0c15e8439 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2074798960" status: 404 len: 99 microversion: 2.1 time: 0.038702 Aug 29 23:58:07.577381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 371/719] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:58:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2074798960 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:58:07.581732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f4076eb4-8d9d-4d10-b549-4facd749c4ee tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003793 Aug 29 23:58:07.582228 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 349/720] 10.222.0.90 () {58 vars in 1140 bytes} [Mon Aug 29 23:58:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:58:07.590973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ec13b777-ce4e-4f24-b1cc-7ba1c2b555ba tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003724 Aug 29 23:58:07.591474 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 372/721] 10.222.0.90 () {58 vars in 1137 bytes} [Mon Aug 29 23:58:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:58:07.600159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bd6cfcdd-ceb8-4823-8801-141bbab82d2e tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Calling method '.version_select at 0x7fd5a64aedc0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:07.629086 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-bd6cfcdd-ceb8-4823-8801-141bbab82d2e tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] HTTP exception thrown: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bd6cfcdd-ceb8-4823-8801-141bbab82d2e tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/os-volumes/42a44eff-5bce-419b-9f83-d9984246915f HTTP/1.1 Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:58:07.632308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '42a44eff-5bce-419b-9f83-d9984246915f'} Aug 29 23:58:07.633897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. (HTTP 404) (Request-ID: req-d113b333-6874-49f7-a6cb-94e131857e20) Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.634934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:58:07.637020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:58:07.638995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bd6cfcdd-ceb8-4823-8801-141bbab82d2e tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 404 to user: Volume 42a44eff-5bce-419b-9f83-d9984246915f could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bd6cfcdd-ceb8-4823-8801-141bbab82d2e tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/42a44eff-5bce-419b-9f83-d9984246915f" status: 404 len: 109 microversion: 2.1 time: 0.037355 Aug 29 23:58:07.640398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 350/722] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:58:07 2022] DELETE /compute/v2.1/os-volumes/42a44eff-5bce-419b-9f83-d9984246915f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:07.644040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-33a26742-35d3-4d1e-a887-370ec2805035 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Calling method '.version_select at 0x7fd5a6433d30>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:07.671424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-33a26742-35d3-4d1e-a887-370ec2805035 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] HTTP exception thrown: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-33a26742-35d3-4d1e-a887-370ec2805035 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Request method failure captured: Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/os-volumes/9d38372b-d87c-4fb9-ba8c-877078b53f82 HTTP/1.1 Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVKPKwQjbfd6Io_kh3mctkeSKUGdjq2DwpGlDss_C6rfYBD0RMcMShn__jSc9W05HLCU4ps43wxoJpnmed8Bl7bE3oeOptZ8kNNNCcopsY-G0Ai4eOS_jYLdNjVCG4dTxSC9TDB6qpkNcU0GoinHDE_0ntpqvN4_swFuTL4uc-YPqRU Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:58:07.673390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6acb22938bb84244beec8e96ded27cca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6acb22938bb84244beec8e96ded27cca"}]}] Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 6acb22938bb84244beec8e96ded27cca Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesNegativeTest-262612655 Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 20da2cdc6de24c4e8af0bef371f7ceec Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesNegativeTest-262612655-project Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '9d38372b-d87c-4fb9-ba8c-877078b53f82'} Aug 29 23:58:07.674941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. (HTTP 404) (Request-ID: req-1522c6f1-301a-4578-8a33-bf4432625eb9) Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.676003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:58:07.677653 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:58:07.679023 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-33a26742-35d3-4d1e-a887-370ec2805035 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] Returning 404 to user: Volume 9d38372b-d87c-4fb9-ba8c-877078b53f82 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-33a26742-35d3-4d1e-a887-370ec2805035 tempest-VolumesNegativeTest-262612655 tempest-VolumesNegativeTest-262612655-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9d38372b-d87c-4fb9-ba8c-877078b53f82" status: 404 len: 109 microversion: 2.1 time: 0.034529 Aug 29 23:58:07.680515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 373/723] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:58:07 2022] GET /compute/v2.1/os-volumes/9d38372b-d87c-4fb9-ba8c-877078b53f82 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:09.441032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1abe417e-3dbd-42b2-91a4-c258ee4af948"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:09.441032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:09.441744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.446339 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.446825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.447266 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.447964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.448444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.455757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.537656 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments HTTP/1.1 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 74 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:58:09.539090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {"volumeAttachment": {"volumeId": "1abe417e-3dbd-42b2-91a4-c258ee4af948"}} Aug 29 23:58:09.540555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'server_id': 'b35389dd-c528-4d6d-8519-fdb7a2d94c2c', 'body': {'volumeAttachment': {'volumeId': '1abe417e-3dbd-42b2-91a4-c258ee4af948'}}} Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:09.541610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:09.542959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 400 to user: Invalid volume: volume 1abe417e-3dbd-42b2-91a4-c258ee4af948 is already attached to instances: b35389dd-c528-4d6d-8519-fdb7a2d94c2c {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eceb73e4-aeb7-40a3-a533-ff0162577e62 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111399 Aug 29 23:58:09.546618 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 351/724] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:58:09 2022] POST /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:58:09.612450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:09.613085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:09.615050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.620263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.620938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.621637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.622397 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.622852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.623333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.713916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'services' on Instance uuid b35389dd-c528-4d6d-8519-fdb7a2d94c2c {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:09.970428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-646e0bd8-1a66-4841-a4b0-e4abd35933a2 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments/1abe417e-3dbd-42b2-91a4-c258ee4af948" status: 202 len: 0 microversion: 2.1 time: 0.362164 Aug 29 23:58:09.971496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 374/725] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:58:09 2022] DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments/1abe417e-3dbd-42b2-91a4-c258ee4af948 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:58:09.980616 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:09.983119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:09.990647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.991173 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.991606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.992366 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.992832 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.993255 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:10.031943 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f8902202-72e3-47b7-87e1-b582d742f1fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055699 Aug 29 23:58:10.032659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 352/726] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:09 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:11.052387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:11.055812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:11.067890 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:11.068497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:11.068955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:11.069695 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:11.070285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:11.070721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:11.109438 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-15f0c5f3-c7fa-4f70-b75c-a6bcfd6685ff tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065245 Aug 29 23:58:11.110214 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 375/727] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:11 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:12.125505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:12.128289 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:12.137486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.138044 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.138543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.139316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.139866 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.140442 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.172584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3a249ee0-a909-4e1a-8591-788ed8308129 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053831 Aug 29 23:58:12.178594 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 353/728] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:12 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:58:12.250900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:12.250900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:12.253077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.253537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.254282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.254896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.255330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.255756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.288751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:58:12.565039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e9222629-f45a-490f-b0bf-222c4caf65a8 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 204 len: 0 microversion: 2.1 time: 0.323390 Aug 29 23:58:12.565637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 376/729] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:12 2022] DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:58:12.575615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:12.576247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:12.584042 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.584740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.585482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.586377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.586890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.587434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.742677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:12.756087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9f8a7f2f-d06d-4e9c-865e-37c374d59e12 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1680 microversion: 2.1 time: 0.185255 Aug 29 23:58:12.768688 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 354/730] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:12 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:12.931093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:12.931674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:12.939823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.940354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.940788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.941486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.941938 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.942357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.970169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f5428b04-46bf-4e5f-9fd2-7ce193490f4d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/ips" status: 200 len: 153 microversion: 2.20 time: 0.266458 Aug 29 23:58:12.974931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 377/731] 10.222.0.90 () {60 vars in 1289 bytes} [Mon Aug 29 23:58:12 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/ips => generated 153 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:58:13.789603 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:13.790292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:13.798123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:13.798123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:13.798377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:13.798957 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:13.799400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:13.799809 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:14.091001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:14.099528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-48d1f7bc-f20c-4788-a1ff-fa5fba5bcb8e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1680 microversion: 2.1 time: 0.314654 Aug 29 23:58:14.103271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 355/732] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:13 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:15.122232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:15.122846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:15.130112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.130630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.131278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.131999 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.132590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.133280 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.239344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:15.240277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:15.250689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.250689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.250689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.251464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.252019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.252700 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.284725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lazy-loading 'flavor' on Instance uuid a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:15.368200 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:15.377921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-77126a0e-132d-4544-86e3-679cf6923455 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1680 microversion: 2.1 time: 0.260130 Aug 29 23:58:15.378450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 378/733] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:15 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:15.590071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.883837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d21d6601-6be1-4835-bf2e-bcaf87765090 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/action" status: 202 len: 0 microversion: 2.20 time: 0.645007 Aug 29 23:58:15.885063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 356/734] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 23:58:15 2022] POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:58:15.900232 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:15.905431 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:15.915612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.916622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.917481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.919362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.920419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.921215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.962091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35389dd-c528-4d6d-8519-fdb7a2d94c2c", "name": "network-vif-deleted", "tag": "ed6ca7d8-37df-4692-9d8b-45582a2ea5c7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:15.976711 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.980319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.980319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:16.001211 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] Creating event network-vif-deleted:ed6ca7d8-37df-4692-9d8b-45582a2ea5c7 for instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c on hv-cinder-85504 Aug 29 23:58:16.007425 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-0ab27d3b-d4f4-4b7a-ae7d-b5f2d182730a req-adbfee87-ef01-4634-879e-85a578ace713 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262665 Aug 29 23:58:16.008410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 379/735] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:16.113509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:16.132823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:16.136045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:16.138591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9b603262-6a7a-4dfb-99b8-60754ce0883b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.247450 Aug 29 23:58:16.140060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 357/736] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:15 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:16.401272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:16.415265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:16.415265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:16.415265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:16.415265 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:16.415835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:16.415835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:16.415835 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:16.449541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:16.450110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:16.450552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:16.455199 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'fault' on Instance uuid b35389dd-c528-4d6d-8519-fdb7a2d94c2c {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:16.496365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:16.504566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f79d021b-1c05-4b97-a6b3-eaa67830aa53 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 200 len: 1331 microversion: 2.1 time: 0.108438 Aug 29 23:58:16.505242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 380/737] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:16 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:17.164036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:17.164895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:17.172225 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:17.172713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:17.173141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:17.173866 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:17.174311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:17.174772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:17.337829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.352775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.355895 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.358288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-39c49b94-2566-47b5-9aca-44b70d19a685 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.198256 Aug 29 23:58:17.359323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 358/738] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:17 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:17.527943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:17.528747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:17.537070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:17.537729 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:17.538370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:17.539279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:17.539770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:17.540326 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:17.558403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c HTTP/1.1 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:58:17.560247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:58:17.561780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'b35389dd-c528-4d6d-8519-fdb7a2d94c2c'} Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:17.564993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:58:17.566693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:58:17.567830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:17.567830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-854ebab7-003f-4f0a-bbd6-4617ab9dd632 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 404 len: 111 microversion: 2.1 time: 0.039503 Aug 29 23:58:17.567830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 381/739] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:17 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:17.573070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-29d03128-7dd1-48c0-ad96-ee7cac6b0b30 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '.version_select at 0x7fd5a65410d0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:17.659780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-29d03128-7dd1-48c0-ad96-ee7cac6b0b30 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809885816" status: 202 len: 0 microversion: 2.1 time: 0.091479 Aug 29 23:58:17.660813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 359/740] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:58:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809885816 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:58:18.384223 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:18.385240 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:18.393896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.394894 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.395663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.397331 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.397952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.398557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.578266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.596772 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.600089 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.601975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-76a6b305-1c3f-4f71-95a9-08799b8b6ffe tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.222300 Aug 29 23:58:18.602975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 382/741] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:18 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:18.645486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bdb98704-b2f2-4e04-89ba-c9188c222f0c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: .version_select at 0x7fd5a6a50dc0>, body: {"keypair": {"name": "tempest-keypair-305939954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNiTNvTXxUXcssAHlOi7r7qmc9U/j5R01GKfQAWydUD+vLoIrrtoddnAaRa7IcZdfX5wd4hP/BYJnkQfjxxl2c1bLYyt8N63OMXegjf1j5ajghtXzVgEJa/WNU+kHaoeg=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:18.664567 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-bdb98704-b2f2-4e04-89ba-c9188c222f0c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:58:18.670159 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-bdb98704-b2f2-4e04-89ba-c9188c222f0c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:58:18.793508 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bdb98704-b2f2-4e04-89ba-c9188c222f0c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147978 Aug 29 23:58:18.793508 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 360/742] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:58:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:19.627610 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:19.628301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:19.635604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.636716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.637072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:19.637841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.638302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.638733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:19.803367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.812829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.814283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.815482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d30047bd-1903-44f7-93a2-39f4989fc766 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.191902 Aug 29 23:58:19.816050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 383/743] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:19 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:20.840222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:20.840831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:20.850283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:20.856546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:20.856546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:20.856546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:20.856546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:20.857012 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:21.034017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:21.044909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:21.046747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:21.048315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b51dc231-62d4-4ed7-bcf5-9125afb308c6 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.212713 Aug 29 23:58:21.049055 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 361/744] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:20 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:21.516383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1276268827", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b40027-b034-467e-a623-8d465afe9154"}], "security_groups": [{"name": "tempest-securitygroup--675687008"}], "key_name": "tempest-keypair-305939954", "user_data": "}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:21.637959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] validate_networks() for [('60b40027-b034-467e-a623-8d465afe9154', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:58:22.072632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:22.073865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:22.081439 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.082300 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.082643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.083342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.083645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.084080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.256390 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:58:22.257358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:58:22.258003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:58:22.258737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:58:22.259550 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:58:22.279111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.279800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.280421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.281309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.281907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.282603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.296963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.305610 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.307131 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.307311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:58:22.308930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cedbe97f-c9d5-4437-a474-2dc5f7501eec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.240479 Aug 29 23:58:22.309531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 362/745] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:22 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:22.314434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Getting quotas for user 829e698428cd4e9ca05aabb9c25c6fb3 and project a2963b1b4aba47f593c63a398b511792. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:58:22.334927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:58:22.337297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:58:22.466680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6c5acce7-9f81-42e7-bc74-fe0f691f948e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.956529 Aug 29 23:58:22.467463 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 384/746] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:58:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:58:22.480461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-99207c91-3257-400d-82c7-e128941bfabf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:22.481248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-99207c91-3257-400d-82c7-e128941bfabf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:22.551921 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-99207c91-3257-400d-82c7-e128941bfabf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.562392 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-99207c91-3257-400d-82c7-e128941bfabf tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1241 microversion: 2.1 time: 0.087074 Aug 29 23:58:22.563178 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 363/747] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:22 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:23.321540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:23.322482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:23.328697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.335289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.335841 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.336612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.337252 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.338457 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.341503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:23.342436 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:23.352637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.353112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.353546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.355058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.355641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.356072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.372750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9ece579f-f695-4e52-8520-1d9d64265d54 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/ips" status: 200 len: 146 microversion: 2.1 time: 0.055765 Aug 29 23:58:23.373348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 385/748] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:58:23 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:23.545716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.560933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.563927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.566021 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1ec6be69-92c7-44e9-b08c-c7c744efeaeb tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.232292 Aug 29 23:58:23.566981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 364/749] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:23 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:23.590049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:23.590049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:23.593809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.594383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.594823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.595560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.596073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.596543 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.666505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.675292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8d8bb60d-6623-40a8-9b76-5b9c4847b38f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1245 microversion: 2.1 time: 0.095233 Aug 29 23:58:23.675881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 386/750] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:23 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:24.594266 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:24.594946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:24.602626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.603127 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.603630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.604530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.605226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.605859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.696878 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:24.697713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:24.705771 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.706855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.707449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.708218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.708682 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.709112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.796150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.816486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1c792f3c-b5d3-45c5-ad28-1fa9d6239cfa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1293 microversion: 2.1 time: 0.120790 Aug 29 23:58:24.821319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.828662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 387/751] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:24 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1293 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:24.836239 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.839235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.841782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0407a31b-28e8-495b-9fa1-610ef678fb1a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.251375 Aug 29 23:58:24.843037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 365/752] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:24 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:25.301421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff2f3042-278f-451c-9690-22bc0d3b1428"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:25.304558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:25.312881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.313536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.314058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.314902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.315441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.315945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.850652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:25.851585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:25.864596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.865315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.866015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.867217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.868064 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.868777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.986786 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:25.997461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f43ef313-dc2f-46be-b627-5114790df54c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1299 microversion: 2.1 time: 0.151810 Aug 29 23:58:25.998063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 366/753] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:25 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:26.003222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:26.004106 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:26.014030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:26.014801 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:26.015394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:26.016316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:26.017456 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:26.018119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:26.225905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.236164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.237697 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.238901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d639d711-3131-43f3-86bf-f9484f6cdbaa tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.239730 Aug 29 23:58:26.239741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 367/754] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:25 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:26.281090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:26.567129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ec6002b2-9a17-499a-b1b5-9696f8739ce7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.269283 Aug 29 23:58:26.576033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 388/755] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:58:25 2022] POST /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 194 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:27.035156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:27.035742 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:27.042874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.043633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.044310 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.045037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.045530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.045953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.246840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.253752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-94846ff2-2346-4c29-b683-4fdc85f523fa tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.222579 Aug 29 23:58:27.269715 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 368/756] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:27 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:27.271218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:27.272138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:27.280503 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.280988 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.281421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.282176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.282666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.283085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.462625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.471713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.473180 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.474386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-68064e70-78c6-43e8-abce-f219fecf92ec tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1744 microversion: 2.20 time: 0.212270 Aug 29 23:58:27.474944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 389/757] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:27 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:27.547667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa54094f-c31b-41ec-ab2d-2e80b4e30cfe", "tag": "69e68088-d17f-4c25-8006-de53d82f4084"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:27.557672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.558165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.558596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.580231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] Creating event network-changed:69e68088-d17f-4c25-8006-de53d82f4084 for instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe on hv-cinder-85504 Aug 29 23:58:27.586589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-333e0e57-1090-4816-9403-62f07642d4d9 req-a186149f-0d56-49a3-8a29-03aa45ed2a08 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042527 Aug 29 23:58:27.587339 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 369/758] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:28.282210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:28.282904 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:28.290959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.291450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.292013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.293040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.293496 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.293927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.447788 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.456637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b0143fe7-c879-4f30-b309-eaa92cee199f tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.181898 Aug 29 23:58:28.457221 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 390/759] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:28 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:28.504487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:28.505779 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:28.516364 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.517203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.517931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.519097 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.519676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.520448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.692198 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.701902 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.708300 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.709524 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1fd79e95-6965-4d52-a2c6-46f577f5006c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1744 microversion: 2.20 time: 0.213703 Aug 29 23:58:28.710099 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 370/760] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:28 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:29.477553 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.478206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.486282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.486762 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.487198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.487905 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.488389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.488816 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.646871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.655005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-992ee2ac-abac-4e46-850b-343af0b2a336 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.181282 Aug 29 23:58:29.655593 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 391/761] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:29 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:29.750759 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.751518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.758757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.759251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.759679 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.760937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.761490 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.762009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.937270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.938789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.940486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.941666 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7933b171-66f2-4abc-b110-923c2072d5bd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.196744 Aug 29 23:58:29.942577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 371/762] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:29 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:30.115020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "name": "network-vif-plugged", "status": "completed", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:30.128471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.129103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.129103 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.141014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] Creating event network-vif-plugged:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:58:30.145980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-cbf05919-4d49-4833-a60e-7264f8dc52bb req-76a63cc1-6ca3-4125-9b1e-7e651db47440 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172601 Aug 29 23:58:30.146590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 392/763] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:30.683947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:30.683947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:30.690267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.691030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.691462 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.692352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.692665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.693087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.864799 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.884011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-75ab03b6-38a0-406f-9af1-5b49464b1481 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.199116 Aug 29 23:58:30.884011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 372/764] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:30 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:30.975848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:30.976676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:30.986411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.986978 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.987614 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.988386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.988886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.989312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.183818 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:31.194954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:31.196570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:31.198550 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-18a8284e-4eae-476c-9559-023ff2e0682d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.226547 Aug 29 23:58:31.199513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 393/765] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:30 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:31.901869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:31.902718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:31.909892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.910928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.911604 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.912434 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.913058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.913674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.107678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.117360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8b28cfb6-5c79-49b7-83bd-40028b8c57e7 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.219774 Aug 29 23:58:32.117953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 373/766] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:31 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:32.223183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:32.224606 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:32.235863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.236502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.237206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.238162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.238823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.239447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.295119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:32.329316 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=6 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:32.408227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.420984 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.422430 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.423598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a44e16bf-5be9-40d6-8365-3896812de81d tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.204754 Aug 29 23:58:32.424510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 394/767] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:32 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:33.147630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:33.156088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:33.156088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:33.156487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.156811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.157359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.158073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.158522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.158974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.337747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.349086 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-74568aed-4b51-4993-a7c5-9e598124dd4c tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.205626 Aug 29 23:58:33.351837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 374/768] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:33 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:33.452384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:33.455358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:33.464861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.465784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.466447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.467419 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.468241 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.468993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.642451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.653793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.655542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.656963 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e1fc3e5a-3ef3-484d-a7a6-e3d593e50f18 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.213289 Aug 29 23:58:33.672201 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 395/769] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:33 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:33.939190 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa54094f-c31b-41ec-ab2d-2e80b4e30cfe", "name": "network-vif-plugged", "status": "completed", "tag": "69e68088-d17f-4c25-8006-de53d82f4084"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:33.958244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.958719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.959341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.975080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] Creating event network-vif-plugged:69e68088-d17f-4c25-8006-de53d82f4084 for instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe on hv-cinder-85504 Aug 29 23:58:33.981540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-14b61ca6-8ede-4b09-8f97-5a6869823e84 req-bf73f473-45db-46d1-9510-7c498df56456 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047557 Aug 29 23:58:33.982374 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 375/770] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:34.374549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:34.375473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:34.382366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.383112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.383715 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.385060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.385789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.386958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.600197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.609386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2830cb6c-5c51-4cb9-916f-50a53a470d27 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.239589 Aug 29 23:58:34.609976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 396/771] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:34 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:34.683134 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:34.684070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:34.692217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.692701 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.693323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.694296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.694920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.695346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.865001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.874692 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.876162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.877454 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-26930675-33d5-4acc-a6c6-54ead2c94174 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.199153 Aug 29 23:58:34.878048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 376/772] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:34 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:35.342689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.345733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.361204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.361975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.362708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.363745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.364304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.366971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.444929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9798c0af-686e-477c-88f1-2945fd0e8fdb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111140 Aug 29 23:58:35.446175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 397/773] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:35.496253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.496749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.504462 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.505260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.505881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.506620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.507244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.507673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.538168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:35.544105 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a45aa898-124d-4646-9da8-cbecba9fdcce tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428" status: 200 len: 194 microversion: 2.1 time: 0.052085 Aug 29 23:58:35.548541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 377/774] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:35.640027 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.641966 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.655355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.656870 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.658131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.660382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.674247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.674247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.911705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.912831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.937484 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.938342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.952278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.952447 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.952555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.952555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.953584 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.959702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f0d033f6-eecd-4fda-a2d1-f8f809d84690 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1366 microversion: 2.1 time: 0.328714 Aug 29 23:58:35.962406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 398/775] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:36.192504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:36.211719 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:36.213242 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:36.214673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0f4c3bca-a490-4290-8eaf-3b55d1a067b4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.317069 Aug 29 23:58:36.215259 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 378/776] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:37.006134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:37.007230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:37.030379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.031085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.031530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.032295 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.032803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.033561 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.245996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:37.248027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:37.263612 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.265072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.266230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.268195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.273199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.273199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.310594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.333958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3df2c36d-245d-4102-9a01-b0728430bb4e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1557 microversion: 2.1 time: 0.336367 Aug 29 23:58:37.334951 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 399/777] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:36 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1557 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:37.377011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:37.378354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:37.390672 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.391991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.393675 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.396277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.397567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.398661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.893536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-04dbb0da-5c63-4e63-aaf5-027230c42416 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.524004 Aug 29 23:58:37.894188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 400/778] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 23:58:37 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-interface => generated 285 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:37.899872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e608419f-e7b5-4128-89e7-b1f4f37a79ad"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:37.904341 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:37.912396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.913232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.915338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.915338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:37.916060 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:37.916828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.952010 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.962276 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.976383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.976383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9473fb3a-c493-4950-8904-eac06a7d8b01 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.728697 Aug 29 23:58:37.976383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 379/779] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:37 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:39.000117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:39.002336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:39.046539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.057487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b93d8c13-9b74-4750-a685-208bac6277d7 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "POST /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.149655 Aug 29 23:58:39.076381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.077655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.077973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 401/780] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:58:37 2022] POST /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 194 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:39.080501 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.082018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.083101 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.312922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:39.324389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:39.334117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:39.340274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b3da0813-afb9-4024-9e43-615c6c30a00c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.348988 Aug 29 23:58:39.342470 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 380/781] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:38 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:39.931649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa54094f-c31b-41ec-ab2d-2e80b4e30cfe", "tag": "69e68088-d17f-4c25-8006-de53d82f4084"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:39.945971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.946785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.947315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.967810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] Creating event network-changed:69e68088-d17f-4c25-8006-de53d82f4084 for instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe on hv-cinder-85504 Aug 29 23:58:39.979279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-19668561-d00a-4422-8822-566595c982b4 req-8113177e-8fbb-452a-a1af-fc8dfc8c8aec service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051852 Aug 29 23:58:39.981586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 402/782] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:40.371693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:40.376655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:40.406027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.407234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.407234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.408588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.409188 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.409721 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.675590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.685207 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.687021 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.688587 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7ca102ee-68c9-408f-956c-80c9d295ea50 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.325397 Aug 29 23:58:40.689375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 381/783] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:40 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:41.713587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:41.714414 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:41.716618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:41.727828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:41.735505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:41.735505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:41.735505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:41.735505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:41.736083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:41.951668 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.966197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.970669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.971961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ba759d11-8979-42c7-b5c8-f9e2c24b2e36 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.263365 Aug 29 23:58:41.972596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 403/784] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:41 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:42.997915 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:42.998452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:43.000785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:43.005505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.005990 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.006429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.007117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.007565 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.007988 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.148680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:43.161087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:43.167766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:43.167766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5b08010f-05d1-4d50-9559-40dfe9fb6741 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1739 microversion: 2.20 time: 0.170783 Aug 29 23:58:43.167766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 382/785] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:42 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:44.187903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.188532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.195299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.195884 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.196702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.197516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.197970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.198727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.335522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:44.349996 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:44.353320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:44.355322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3a7be250-7fd8-4572-8e4c-79d0ade669f4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1721 microversion: 2.20 time: 0.171280 Aug 29 23:58:44.356106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 404/786] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:44 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:44.657702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1005741866", "imageRef": "af1c960b-8609-44ff-a5e6-3483a45dfc15", "flavorRef": "452"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:44.711885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] validate_networks() for None {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:58:44.998721 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:58:44.999135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:58:44.999638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:58:45.000123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:58:45.000564 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:58:45.010107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.011313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.011904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.012684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.013140 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.013568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.030614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Getting quotas for project a48ed3d3cc6b4161a00b765c7ac84170. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:58:45.034670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Getting quotas for user e3e604c47ced4d09abedcf63d98b3a35 and project a48ed3d3cc6b4161a00b765c7ac84170. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:58:45.047075 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:58:45.049394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af1c960b-8609-44ff-a5e6-3483a45dfc15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:58:45.173186 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2406df6d-066e-40f0-a074-470a8e5c4744 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519037 Aug 29 23:58:45.174019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 383/787] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:58:45.185608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4efbca03-dd25-45e0-a3cd-e9ed6f1334c0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:45.186217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4efbca03-dd25-45e0-a3cd-e9ed6f1334c0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:45.246034 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4efbca03-dd25-45e0-a3cd-e9ed6f1334c0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:45.252314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4efbca03-dd25-45e0-a3cd-e9ed6f1334c0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1215 microversion: 2.1 time: 0.071401 Aug 29 23:58:45.252914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 405/788] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:45 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:45.379166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:45.379766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:45.386507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.386979 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.387409 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.388095 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.388597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.389024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.530660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:45.538861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:45.540563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:45.541740 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f4d17a32-4880-49ef-b2d3-2eb704781b83 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1721 microversion: 2.20 time: 0.166769 Aug 29 23:58:45.542308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 384/789] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:45 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:45.810416 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "name": "network-vif-unplugged", "status": "completed", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:45.830005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.835567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.835567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.847410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] Creating event network-vif-unplugged:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:58:45.852232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-43129c12-8ed8-48ca-80bb-d9eecbb2688c req-cbbcf89d-e79f-4c89-93f8-228fc2fdee70 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049697 Aug 29 23:58:45.853073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 406/790] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:46.273254 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:46.273862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.281566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.281878 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.282305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.283003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.283458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.283961 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.376465 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:46.383411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-17ba1739-0df8-4368-9d38-b6e4a291abbe tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1219 microversion: 2.1 time: 0.113918 Aug 29 23:58:46.384301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 385/791] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:46 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:46.567689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:46.568429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.574873 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.575208 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.575644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.576377 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.576838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.577266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.593524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:46.726616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:46.736537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:46.737972 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:46.739484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-11ba5a86-64f9-4a4f-810a-d0b9cb092a90 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1724 microversion: 2.20 time: 0.176636 Aug 29 23:58:46.740090 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 407/792] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:46 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:46.770568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b223564b-9db3-4bdf-a778-458ca488c70f"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:46.773265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.780751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.781240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.781673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.782373 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.782823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.783278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:47.407623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:47.408287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:47.415234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:47.415716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:47.416141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:47.416877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:47.417348 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:47.417771 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:47.488012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:47.501806 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4475400b-c03d-4500-ba4b-2fa8b3ed570f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1267 microversion: 2.1 time: 0.097893 Aug 29 23:58:47.502855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 408/793] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:47 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:48.002936 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.005386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.013287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.017112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.017112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.017112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.017112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.017517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.050510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c7ff00aa-b438-44f3-a717-009d791a84d9 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052180 Aug 29 23:58:48.051111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 409/794] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:47 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:48.063589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bb0094c4-8c16-416d-961f-5a102e1e302c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.298977 Aug 29 23:58:48.064333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 386/795] 10.222.0.90 () {62 vars in 1364 bytes} [Mon Aug 29 23:58:46 2022] POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments => generated 188 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:58:48.193503 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.194041 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.200908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.201410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.201940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.202787 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.203254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.203666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.251256 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.251793 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.253089 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7acd4520-f289-4023-a6d6-487952986a75 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428" status: 200 len: 194 microversion: 2.1 time: 0.063729 Aug 29 23:58:48.254097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 410/796] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 23:58:48 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:48.258671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.261947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.262825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.263835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.265044 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.265754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.269459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.270827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.273981 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.274548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.275284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.276361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.277545 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.278318 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.379068 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lazy-loading 'services' on Instance uuid 49ca1939-82ad-4ef4-a1b5-ba654f65c022 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:48.729977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-712e0d0d-3466-4596-9697-67000730d72e tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428" status: 202 len: 0 microversion: 2.1 time: 0.468741 Aug 29 23:58:48.730872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 411/797] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:58:48 2022] DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/ff2f3042-278f-451c-9690-22bc0d3b1428 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:58:48.736049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.736776 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.743420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.744232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.745570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.747267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.748421 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.749207 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.876987 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:48.885398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a44cdda7-c5cd-4270-9559-7b3e3c1cc377 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1273 microversion: 2.1 time: 0.153195 Aug 29 23:58:48.886011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 412/798] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:48 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:49.187004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ff97b17-9296-4698-8a20-203f6ea20177 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments/b223564b-9db3-4bdf-a778-458ca488c70f" status: 202 len: 0 microversion: 2.20 time: 0.939940 Aug 29 23:58:49.187925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 387/799] 10.222.0.90 () {60 vars in 1457 bytes} [Mon Aug 29 23:58:48 2022] DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments/b223564b-9db3-4bdf-a778-458ca488c70f => generated 0 bytes in 942 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:58:49.254472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:49.259171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:49.262865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.263363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.263799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.264572 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.265033 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.265455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.300393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127669) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 23:58:49.596242 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ded742bb-0c1a-483a-92cc-ff267e7bab6e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/action" status: 202 len: 0 microversion: 2.20 time: 0.345825 Aug 29 23:58:49.597109 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 413/800] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 23:58:49 2022] POST /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:58:49.606707 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:49.607393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:49.636511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.637047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.637523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.638241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.638689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.639104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.813468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:49.830846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:49.838949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:49.838949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c38a3ec6-0ab2-455d-bbb5-1b8c7cc24cc0 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1672 microversion: 2.20 time: 0.232102 Aug 29 23:58:49.849772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 388/801] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:49 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:49.913215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:49.914593 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:49.922622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.923662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.924155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.925327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.925989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.926623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:50.106993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:50.116026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3017bb88-1e1e-4f98-b310-e23ee519c1c2 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.206878 Aug 29 23:58:50.120314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 414/802] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:49 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:50.416394 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68d57c0-358c-4b93-b5b3-b7fb49156134", "tag": "042656a0-e1ea-4671-9425-bbdf1a21a1a4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:50.428144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:50.428667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:50.429096 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:50.441109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] Creating event network-changed:042656a0-e1ea-4671-9425-bbdf1a21a1a4 for instance d68d57c0-358c-4b93-b5b3-b7fb49156134 on hv-cinder-85504 Aug 29 23:58:50.447398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-7bc09bd7-a4e2-478e-ba98-564c99e419fa req-42bdfd31-5f54-4937-bd2f-26bf948a4d05 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034619 Aug 29 23:58:50.448587 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 389/803] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:50.860041 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:50.863102 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:50.872616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:50.873260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:50.873777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:50.874765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:50.875471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:50.876231 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.008874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:51.009703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:51.019359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.020158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.021195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.022699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.023317 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.023892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.043898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:51.049304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:51.057824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:51.058594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:51.059857 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3691be09-f199-4064-a094-ba7634ff5f2e tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1672 microversion: 2.20 time: 0.206154 Aug 29 23:58:51.060782 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 415/804] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:50 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:51.082378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-27f1e121-11f9-4e30-a30a-50514916d919 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/e608419f-e7b5-4128-89e7-b1f4f37a79ad" status: 200 len: 194 microversion: 2.1 time: 0.078016 Aug 29 23:58:51.083391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 390/805] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 23:58:51 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/e608419f-e7b5-4128-89e7-b1f4f37a79ad => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:51.094131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:51.094734 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:51.101038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.101624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.102134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.102906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.103436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.103994 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.153845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:51.154534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:51.161219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.161738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.162416 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.163204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.163834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.164291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.205435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lazy-loading 'services' on Instance uuid 49ca1939-82ad-4ef4-a1b5-ba654f65c022 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:51.317328 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:51.329118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a8b514c9-9f9a-484e-827a-7ce01dcb2854 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.180804 Aug 29 23:58:51.329708 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 391/806] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:51 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:51.489551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7f08bb92-a004-4ae5-b363-64eff3124bcd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/e608419f-e7b5-4128-89e7-b1f4f37a79ad" status: 202 len: 0 microversion: 2.1 time: 0.399283 Aug 29 23:58:51.490082 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 416/807] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:58:51 2022] DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments/e608419f-e7b5-4128-89e7-b1f4f37a79ad => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:58:52.088306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:52.089772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:52.100652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:52.101206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:52.103745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.103745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:52.103745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:52.103745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.260166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:52.271815 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:52.273386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:52.274716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9cb82b1a-9f99-40e4-946d-3b0f641cb4c9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1672 microversion: 2.20 time: 0.193576 Aug 29 23:58:52.275357 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 392/808] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:52 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:52.351920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:52.352777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:52.360844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:52.361212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:52.361671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.362365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:52.362809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:52.363226 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.508531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:52.516926 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-098d8bf8-4a80-4b73-b324-4ac15f315b31 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.170259 Aug 29 23:58:52.517520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 417/809] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:52 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:53.302755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:53.303335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:53.310701 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.311134 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.311599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.318869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.318869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.318869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.470218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:53.482959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:53.484672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:53.485900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e3ab1d83-95b2-4aab-97e9-4d9a7047d79a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.187299 Aug 29 23:58:53.486469 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 393/810] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:53 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:53.539736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:53.540358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:53.548134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.548633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.549057 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.549748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.550193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.550687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.701705 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:53.711644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-de7a7f5d-72f2-4130-805d-218844e24544 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.175978 Aug 29 23:58:53.712518 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 418/811] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:53 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:53.771363 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:53.773858 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:53.780674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.781205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.781583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.782271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.782716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.783255 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.820531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9d2a7593-0724-438c-a27f-71aa4b292a23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052885 Aug 29 23:58:53.821328 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 394/812] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:53 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:58:53.984064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:53.986500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:53.994009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.994692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.996387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.997001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.997611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.998166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.059631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-df302bfe-ac40-46e6-840d-eb0050f3b315 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079383 Aug 29 23:58:54.060978 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 419/813] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:53 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:58:54.147476 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:54.147974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:54.154316 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.154804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.155238 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.155971 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.156481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.156901 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.185382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:58:54.510756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:54.511917 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:54.519677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.520458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.520648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.521544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.522469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.522901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.578970 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8d28ffe9-2cd4-4372-8980-9fccc1b8175b tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 204 len: 0 microversion: 2.1 time: 0.435155 Aug 29 23:58:54.580222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 395/814] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:54 2022] DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:58:54.590863 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:54.591597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:54.597865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.598359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.598797 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.599706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.600163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.600622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.713488 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:54.721625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:54.723066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:54.724254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ba3d6d6f-e1f4-4cfa-a0a7-a531f221075a tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.217649 Aug 29 23:58:54.724837 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 420/815] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:54 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:54.742500 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:54.743294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:54.750679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.751168 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.751629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.752358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.752813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.753243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.775671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:54.785026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-71f5255c-aa9c-4915-8076-1f1090a1bb23 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.198610 Aug 29 23:58:54.785572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 396/816] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:54 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:55.091732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.094413 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:55.100677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5a001f5e-81fa-4d92-9bc0-e9401f3ca2cf tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.371506 Aug 29 23:58:55.101264 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 421/817] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:54 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:55.748122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:55.748746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:55.750839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:55.751534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:55.757165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.757643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.764074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.764074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.764074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.764074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.808297 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:55.808950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:55.810775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:55.816266 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.816751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.817181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.817879 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.818347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.818893 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.974027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.983782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.985340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.986558 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aaa20101-ebeb-4740-9d9c-99f15c596675 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.242464 Aug 29 23:58:55.987123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 397/818] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:55 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:56.000344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68d57c0-358c-4b93-b5b3-b7fb49156134", "name": "network-vif-plugged", "status": "completed", "tag": "042656a0-e1ea-4671-9425-bbdf1a21a1a4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:56.014381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:56.017524 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:56.018197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:56.018757 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:56.023467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f2183222-9758-45c6-9da2-01aeabf74b64 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.220017 Aug 29 23:58:56.027492 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 422/819] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:55 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:56.040536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] Creating event network-vif-plugged:042656a0-e1ea-4671-9425-bbdf1a21a1a4 for instance d68d57c0-358c-4b93-b5b3-b7fb49156134 on hv-cinder-85504 Aug 29 23:58:56.046243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a5be10a0-3d75-4d9a-9987-e588bebd4e06 req-89113ad3-a2fb-4c81-b311-e5a16b384c7f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051803 Aug 29 23:58:56.047115 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 398/820] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:56.123925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:56.124660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:56.132124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:56.132654 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:56.133092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:56.133799 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:56.134540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:56.135180 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:56.406325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:56.423046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-98d04bd0-fe23-4792-8066-1ca762f3429c tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.302979 Aug 29 23:58:56.424333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 399/821] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:56 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:57.013339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:57.013950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:57.021344 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.021850 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.022296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.023024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.023542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.023977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.065555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:57.066149 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:57.078954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.079496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.080032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.080881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.081870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.082600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.253008 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:57.264410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:57.266317 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:57.268006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0b736d5e-d0bb-4452-9211-c43b36f8dc56 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.260448 Aug 29 23:58:57.279944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 423/822] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:57 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:57.294531 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:57.302842 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a257872b-8c4c-4497-ba47-c08bf95b7f60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.241302 Aug 29 23:58:57.315268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 400/823] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:57 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:57.453330 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:57.453944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:57.460876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.461374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.461806 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.462532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:57.462992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:57.463418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:57.640710 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:57.658791 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9dfe75eb-dbc0-4903-88c9-fbda8fb742cc tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.213750 Aug 29 23:58:57.662420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 424/824] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:57 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:58.297816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:58.298959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:58.311404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.312313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.313058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.314347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.315402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.316589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.344149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:58.345285 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:58.359807 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.360732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.361536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.363133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.364019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.365034 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.620733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:58.624669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:58.631825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:58.635050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:58.635267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-191cd945-a457-48de-ba6f-32bc31e16fa0 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.299237 Aug 29 23:58:58.635898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 425/825] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:58 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:58.641441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-69c85d28-a5e9-40a1-af57-caa11a215d38 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.351007 Aug 29 23:58:58.642835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 401/826] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:58 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:58.696444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:58.697063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:58.704361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.704855 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.705306 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.706290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:58.706753 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:58.707185 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:58.868616 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:58.881513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2cf8c9e8-2c28-4c4f-8144-56e7653191f4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.188756 Aug 29 23:58:58.882534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 426/827] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:58 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:59.664861 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:59.665967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:59.666139 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:59.666766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:59.676311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:59.676610 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:59.676932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:59.677497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:59.678314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:59.678743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:59.678939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:59.679357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:59.680379 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:59.681978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:59.683506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:59.684695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:00.010351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:00.019712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:00.037004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:00.045290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ef666d59-7f9f-46d4-9f4f-146e07dac6fd tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.388419 Aug 29 23:59:00.045921 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 402/828] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:59 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:00.050845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:00.051500 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:00.059227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:00.059746 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:00.060252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:00.060976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:00.061442 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:00.061871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:00.062918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:00.065702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-51bece19-dacb-4ea1-9b12-2fdae5544ec7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.404054 Aug 29 23:59:00.066871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 427/829] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:59 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:00.255047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:00.264079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0a23c19f-ea2b-4085-9f90-eff8618fd72f tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.216988 Aug 29 23:59:00.264754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 403/830] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:00 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:01.087136 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:01.090379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:01.090551 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:01.091278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:01.098464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.098914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.099352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.100081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.100572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.101164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.107540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.108824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.109581 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.110721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.111557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.113001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.380916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:01.385484 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:01.391412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0e4fe704-c119-40c3-b0a8-a9964f3e4282 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.310863 Aug 29 23:59:01.404200 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 428/831] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:01 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:01.405083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:01.405083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:01.405518 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2b360f17-71fe-4870-8631-03a712d65e47 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.319550 Aug 29 23:59:01.406315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 404/832] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:01 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:01.421218 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:01.422042 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:01.430691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.431472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.431992 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.433249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:01.434368 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:01.434849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:01.602455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:01.614696 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fc79299a-51aa-4c70-9c75-6a81dd328fcb tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.220899 Aug 29 23:59:01.615262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 429/833] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:01 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:02.417323 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:02.418367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:02.425280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.425772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.426208 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.426914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.427366 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.427791 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.437238 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:02.438019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:02.450883 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.451382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.451815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.452658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.453014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.453440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.685374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:02.690154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:02.695357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:02.696967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:02.698935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5f78e80f-15a6-4e92-84d0-60033eceaffd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.266742 Aug 29 23:59:02.699601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6f6a9549-048f-4014-9b76-8609638f3e60 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.285500 Aug 29 23:59:02.699937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 430/834] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:02 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:02.703277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 405/835] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:02 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:02.712467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:02.712467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:02.725398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.725933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.726371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.727093 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:02.727555 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:02.727973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:02.889727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:02.898119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-47a8a2fd-9a87-4a07-a8a8-ef2a8293222e tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.196952 Aug 29 23:59:02.898708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 431/836] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:02 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:03.720158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:03.720796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:03.723215 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:03.723825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:03.727529 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.728029 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.728498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:03.729215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.729713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.730202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:03.733497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.733984 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.734681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:03.734911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:03.735578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.736038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.736498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:03.960697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:03.965101 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:03.969508 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:03.970948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:03.972156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-99bfe99c-c033-4ed4-97bc-d8d0d6e02217 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.252902 Aug 29 23:59:03.972737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 432/837] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:03 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:03.972885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3f7aa833-bc24-4deb-8b43-a898df2c3bcf tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.256440 Aug 29 23:59:03.973695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 406/838] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:03 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:03.978284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:03.979098 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:03.987394 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.988693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.988693 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:03.989092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:03.989557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:03.989982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:04.145459 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:04.158549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b5f47abf-cd9b-48b5-bce3-d77915b2da17 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.184452 Aug 29 23:59:04.160667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 433/839] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:03 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:04.997318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:04.997880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:04.998486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:04.998614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:05.005087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.005575 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.005704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.006005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.006349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.006703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.007154 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.007487 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.007627 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.008573 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.009262 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.009903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.216638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:05.226963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1e85f358-fb41-4c09-8380-f86dcda6ebcc tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1673 microversion: 2.1 time: 0.235310 Aug 29 23:59:05.228082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 407/840] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:04 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:05.230748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:05.237683 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:05.238699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:05.250109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.250931 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.251173 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:05.251643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.252849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.253596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.254312 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.255990 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:05.258985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-31462b0e-e1a0-4716-853e-bd520df78e32 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.265565 Aug 29 23:59:05.260196 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 434/841] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:04 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:05.406119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:05.415641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9d12fdb5-2b63-4a8c-9c60-822bd634fd2d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.186187 Aug 29 23:59:05.416258 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 408/842] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:05 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:05.936757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ca1939-82ad-4ef4-a1b5-ba654f65c022", "name": "network-vif-deleted", "tag": "ef911d73-328b-439d-a53e-4fec1630c68b"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:05.947166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:05.950311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:05.950311 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:05.962849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] Creating event network-vif-deleted:ef911d73-328b-439d-a53e-4fec1630c68b for instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 on hv-cinder-85504 Aug 29 23:59:05.969129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-63653dcc-e3d1-458a-9e95-6ae715c0a770 req-d37697fb-7da0-4010-b8e4-e58097c2bced service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038884 Aug 29 23:59:05.970172 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 435/843] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:06.253405 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:06.254034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:06.270959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.271455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.271889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.272661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.273088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.273510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.292781 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:06.293658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:06.310939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.310939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.310939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.310939 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.311351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.311351 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.365260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:06.374949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bf589cc1-9ddd-4a1c-9f6e-16a5b786f0e8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1321 microversion: 2.1 time: 0.125746 Aug 29 23:59:06.375681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 409/844] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:06 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1321 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:06.437814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:06.447743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:06.447743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.447743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.447743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.449335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:06.449335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:06.449335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:06.461273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:06.471444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:06.473281 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:06.475467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3e856420-f4b8-475a-9be0-ab546e1c6fc7 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.190309 Aug 29 23:59:06.490257 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 436/845] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:06 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:06.625040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:06.633007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-187b4ef6-0f28-4e07-aea3-c28a65b79235 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1315 microversion: 2.1 time: 0.199882 Aug 29 23:59:06.633916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 410/846] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:06 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:07.398282 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:07.398867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:07.406919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.407489 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.407920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.408645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.409097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.409514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.445991 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.446479 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.446920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.447370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lazy-loading 'fault' on Instance uuid 49ca1939-82ad-4ef4-a1b5-ba654f65c022 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:07.496971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b06987b00c245c0b8a9f3f4bb977bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b68600b8657473eb43d16098bbcacf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:07.505289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-544b2744-50a3-49c6-bb17-d03671fb4f53 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 200 len: 1326 microversion: 2.1 time: 0.110812 Aug 29 23:59:07.505874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 437/847] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:07 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:07.506890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:07.507496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:07.514481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.514956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.515385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.516074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.516559 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.516976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.661993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:07.662359 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:07.664372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:07.668953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.673967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.673967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.673967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.673967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.674375 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.674497 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:07.674642 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:07.675755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0b3cedc9-3d70-4483-bd0f-1629a0cd2d1c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.173224 Aug 29 23:59:07.678218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 411/848] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:07 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:07.815470 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:07.817865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=100 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:07.825815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-54662ce4-1e04-4f2d-8e57-02e81608926d tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1465 microversion: 2.1 time: 0.168094 Aug 29 23:59:07.826521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 438/849] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:07 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1465 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:07.877090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:07.877751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:07.884439 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.890687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.890687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.890687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:07.890687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:07.891112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:07.918074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:59:08.312368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-94b8cbfc-cbb9-43b8-8459-9c32d17e42e0 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 204 len: 0 microversion: 2.1 time: 0.439422 Aug 29 23:59:08.312993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 412/850] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:07 2022] DELETE /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:59:08.321861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:08.322460 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:08.328945 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.329429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.329858 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.330600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.331315 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.331730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.472641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:08.480628 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a5ace6ef-0027-4aae-8bd0-f12187da8022 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1471 microversion: 2.1 time: 0.163078 Aug 29 23:59:08.481535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 439/851] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:08 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:08.528387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:08.529089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:08.535723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.536245 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.536685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.537407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.537852 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.538352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.552604 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 HTTP/1.1 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:08.554191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:08.555890 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '49ca1939-82ad-4ef4-a1b5-ba654f65c022'} Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:08.556844 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:08.558886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:08.560863 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:08.560863 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8695cd03-eabf-446b-9ca3-47a1b043169a tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 404 len: 111 microversion: 2.1 time: 0.032283 Aug 29 23:59:08.560863 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 413/852] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:08 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:08.564629 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2f7609cf-980b-4315-99bf-523877f13beb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '.version_select at 0x7fd5a6372160>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:08.702546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:08.703270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:08.710433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.710994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.711440 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.712197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:08.712667 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:08.713129 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:08.875572 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:08.886068 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:08.888291 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:08.889687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-611ce668-8c8a-47ae-b34b-2ca16aef47cd tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.191376 Aug 29 23:59:08.890452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 414/853] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:08 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:09.502241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:09.502983 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:09.509288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:09.509775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:09.510199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:09.510897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:09.511422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:09.512137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:09.668686 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:09.676442 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4d308eb-de82-431c-8137-2f9db5926380 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1471 microversion: 2.1 time: 0.178161 Aug 29 23:59:09.677006 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 415/854] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:09 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:09.702024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2f7609cf-980b-4315-99bf-523877f13beb tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453528483" status: 202 len: 0 microversion: 2.1 time: 1.141020 Aug 29 23:59:09.702612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 440/855] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453528483 => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:09.918074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:09.919016 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:09.945580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:09.945580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:09.945580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:09.945580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:09.946145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:09.946145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:09.946443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "name": "network-vif-plugged", "status": "completed", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:09.972809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:09.972809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:09.972809 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:09.991898 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] Creating event network-vif-plugged:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:59:10.010598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-39b6009e-517a-4f5f-8033-e0f5adf86f11 req-3584ea38-7d5b-4fa1-beb2-5d4a0fc29a04 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066709 Aug 29 23:59:10.010598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 441/856] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:10.178876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:10.190840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:10.197658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:10.197658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a1839dc2-b682-4fc7-8308-79c758a33603 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.281939 Aug 29 23:59:10.211813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 416/857] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:09 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:10.701047 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:10.704363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:10.709519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:10.710679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:10.711189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:10.712016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:10.713119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:10.713119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:10.752668 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68d57c0-358c-4b93-b5b3-b7fb49156134", "name": "network-vif-deleted", "tag": "042656a0-e1ea-4671-9425-bbdf1a21a1a4"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:10.781187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:10.782056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:10.782716 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:10.786200 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:10.795418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9efceb15-d4ff-47b1-a392-61307dda0505 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1429 microversion: 2.1 time: 0.099934 Aug 29 23:59:10.796716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 442/858] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:10 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:10.799933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] Creating event network-vif-deleted:042656a0-e1ea-4671-9425-bbdf1a21a1a4 for instance d68d57c0-358c-4b93-b5b3-b7fb49156134 on hv-cinder-85504 Aug 29 23:59:10.812636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-0056ce8c-e9ea-4f11-bdb1-ba62dd6adcf6 req-fe0a443c-ac99-4f68-a637-5d6daf2a89f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069417 Aug 29 23:59:10.816597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 417/859] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:11.219825 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:11.221634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:11.229868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:11.230765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:11.231563 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:11.232874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:11.233713 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:11.234503 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:11.387119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:11.395910 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:11.399633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:11.399633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1b7f7b8f-6631-440a-a55f-61fcc436fdc9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.183758 Aug 29 23:59:11.399633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 443/860] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:11 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:11.818485 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:11.819069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:11.825616 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:11.826086 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:11.826613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:11.827206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:11.827651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:11.828070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:11.871975 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:11.875928 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:11.876496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:11.878974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:11.878974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lazy-loading 'fault' on Instance uuid d68d57c0-358c-4b93-b5b3-b7fb49156134 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:11.924047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e604c47ced4d09abedcf63d98b3a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48ed3d3cc6b4161a00b765c7ac84170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:11.931949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-994bc70d-c319-4c66-94f0-87f0754b10a4 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 200 len: 1305 microversion: 2.1 time: 0.118559 Aug 29 23:59:11.932544 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 418/861] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:11 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:12.424453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:12.425077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:12.431774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:12.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:12.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:12.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:12.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:12.440070 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:12.623245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:12.633630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:12.635341 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:12.637462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1c4e1a04-a815-4c79-a652-e63940a9dc54 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1730 microversion: 2.20 time: 0.217853 Aug 29 23:59:12.638347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 444/862] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:12 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:12.953346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:12.953946 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] [instance: d68d57c0-358c-4b93-b5b3-b7fb49156134] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:12.961625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:12.966464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:12.966464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:12.966464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:12.966464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:12.966865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:12.980657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] HTTP exception thrown: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Request method failure captured: Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 HTTP/1.1 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVKyubVH873L-Z9rp86T_jb1oUNuXUefzkHuvjiHlVbGv6EX3Ka9nXV_P6jJLCBywq5Zu66tUdMsUb29GQPI_aKOWL3JaF_dfCOq6YDB-Q55wEF9qPR8gQnRhOfNTHmgkXczczCmb0v09QpWkJAMFLRAFFwWFmMdX795Ssajsj_J3Wo Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a48ed3d3cc6b4161a00b765c7ac84170 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-615397037 Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:12.982314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a48ed3d3cc6b4161a00b765c7ac84170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a48ed3d3cc6b4161a00b765c7ac84170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a48ed3d3cc6b4161a00b765c7ac84170", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a48ed3d3cc6b4161a00b765c7ac84170"}]}] Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-615397037 Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a48ed3d3cc6b4161a00b765c7ac84170 Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-615397037 Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-615397037-project Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: e3e604c47ced4d09abedcf63d98b3a35 Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-615397037-project Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. Aug 29 23:59:12.983772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'd68d57c0-358c-4b93-b5b3-b7fb49156134'} Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:12.984644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. Aug 29 23:59:12.986069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:12.987648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] Returning 404 to user: Instance d68d57c0-358c-4b93-b5b3-b7fb49156134 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:12.987648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4edaf9a7-c043-488d-9ee5-4b6e82072e77 tempest-VolumesNegativeTest-615397037 tempest-VolumesNegativeTest-615397037-project] 10.222.0.90 "GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134" status: 404 len: 111 microversion: 2.1 time: 0.034497 Aug 29 23:59:12.987648 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 419/863] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:12 2022] GET /compute/v2.1/servers/d68d57c0-358c-4b93-b5b3-b7fb49156134 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:13.628152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:13.628733 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:13.637270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.637698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.638138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.638970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.639275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.639692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.656392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 HTTP/1.1 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:13.658078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.659692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '49ca1939-82ad-4ef4-a1b5-ba654f65c022'} Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:13.660641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.662110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.663608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:13.663608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c1a5911c-d48b-4515-9bc2-1d41b6fad176 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 404 len: 111 microversion: 2.1 time: 0.035316 Aug 29 23:59:13.663608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 445/864] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:13 2022] DELETE /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:13.664072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:13.664904 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:13.672389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:13.672389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 49ca1939-82ad-4ef4-a1b5-ba654f65c022] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:13.673072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.673566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.673993 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.674781 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.675282 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.675699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.677564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.678066 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.678499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.679229 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:13.679692 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:13.680118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:13.694358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 HTTP/1.1 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:13.695906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.697680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '49ca1939-82ad-4ef4-a1b5-ba654f65c022'} Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:13.699458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. Aug 29 23:59:13.700925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:13.702323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 49ca1939-82ad-4ef4-a1b5-ba654f65c022 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:13.702323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6d111d28-41fa-44b9-86d9-42b5533af277 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022" status: 404 len: 111 microversion: 2.1 time: 0.033454 Aug 29 23:59:13.702323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 446/865] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:13 2022] GET /compute/v2.1/servers/49ca1939-82ad-4ef4-a1b5-ba654f65c022 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:13.826577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:13.836120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:13.837723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:13.839575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-13ea98d3-4fec-4399-9e8f-87005a724619 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1717 microversion: 2.20 time: 0.181979 Aug 29 23:59:13.840919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 420/866] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:13 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:14.429592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:14.430379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:14.433587 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:14.437448 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.437944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.438382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:14.439089 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.439548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.440010 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:14.467716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-29bff91b-d0d1-4fb4-a363-1a4b4184e0f3 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/ips" status: 200 len: 151 microversion: 2.1 time: 0.041811 Aug 29 23:59:14.468406 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 447/867] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:14 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:15.087681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:15.088243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:15.096435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.096994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.097504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.098368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.098878 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.099359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.115062 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 HTTP/1.1 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:15.116647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.118079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '6d3de91e-440c-4c11-97f0-8cc634192f45'} Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:15.118959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.120574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.122019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:15.122019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-267cbc35-0a37-4ee8-a710-7ad6d4c4fcb8 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 404 len: 111 microversion: 2.1 time: 0.034394 Aug 29 23:59:15.122019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 421/868] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:15 2022] DELETE /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:15.129484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:15.130144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] [instance: 6d3de91e-440c-4c11-97f0-8cc634192f45] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:15.138625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.139125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.139561 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.140302 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.140935 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.141366 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.157651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] HTTP exception thrown: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Request method failure captured: Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 HTTP/1.1 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFC-Er14UC6dZ4nAigdZVroTCRzHfSBTrDXipXbsC1sy3DHY0LYPm5m9fBA2ZpYXuBuGoWpfuhWt4NjI_RzYDAaPM11FssUVhLZ-0yHvEgaKOLEoZOtmx3NA776mD9kqnPboGqyvnpSybwJMovMQLbLNvg8EVJwC0kSC3duNHkWq6s Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:15.159598 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b68600b8657473eb43d16098bbcacf6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b68600b8657473eb43d16098bbcacf6"}]}] Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 4b68600b8657473eb43d16098bbcacf6 Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-196462944 Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 9b06987b00c245c0b8a9f3f4bb977bb1 Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeTestJSON-196462944-project Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.161292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '6d3de91e-440c-4c11-97f0-8cc634192f45'} Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:15.162171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. Aug 29 23:59:15.163597 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:15.164924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] Returning 404 to user: Instance 6d3de91e-440c-4c11-97f0-8cc634192f45 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:15.164924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-16388c04-345a-4bc8-ae37-84160900c842 tempest-AttachVolumeTestJSON-196462944 tempest-AttachVolumeTestJSON-196462944-project] 10.222.0.90 "GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45" status: 404 len: 111 microversion: 2.1 time: 0.035606 Aug 29 23:59:15.164924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 448/869] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:15 2022] GET /compute/v2.1/servers/6d3de91e-440c-4c11-97f0-8cc634192f45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:16.216090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dcd514c-97f0-49a6-9631-2413347f75b7"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:16.217905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:16.224414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:16.224887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:16.225311 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:16.226169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:16.226623 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:16.227040 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:16.880464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:17.070986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8a261b00-a3bb-404a-8297-b4f550e09837 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "POST /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860190 Aug 29 23:59:17.071833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 422/870] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 23:59:16 2022] POST /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:22.517006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ed983b43-9156-44ff-95d6-a0e8b62a2f00 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Action: 'create', calling method: .version_select at 0x7fd5a6372f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1361871549"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:23.435923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ed983b43-9156-44ff-95d6-a0e8b62a2f00 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.156383 Aug 29 23:59:23.435923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 449/871] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Aug 29 23:59:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1158 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 23:59:23.442508 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0707be06-8c0a-4156-a055-9ab6ca8aae37 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a6416b80>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:23.500463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0707be06-8c0a-4156-a055-9ab6ca8aae37 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 200 len: 345 microversion: 2.1 time: 0.062570 Aug 29 23:59:23.508767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 423/872] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:23 2022] GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:24.516461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9749e4ca-f36b-41bd-a890-eae45571b910 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a6354040>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:24.569472 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9749e4ca-f36b-41bd-a890-eae45571b910 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 200 len: 346 microversion: 2.1 time: 0.057641 Aug 29 23:59:24.570164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 450/873] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:24 2022] GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:24.584314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ae1945ac-feae-4368-b7c8-8f9ecb7f7001 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Action: 'create', calling method: .version_select at 0x7fd5a63b3700>, body: {"snapshot": {"volume_id": "e94abcf5-f7ec-4c01-9156-b43edb17abaf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-41114470"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:24.980211 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:24.981231 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:24.988329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.989385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.989765 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:24.990574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.991072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.993674 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:25.152786 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'services' on Instance uuid fa54094f-c31b-41ec-ab2d-2e80b4e30cfe {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:25.204649 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ae1945ac-feae-4368-b7c8-8f9ecb7f7001 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.624217 Aug 29 23:59:25.207682 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 424/874] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Aug 29 23:59:24 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:25.220104 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f08ba964-a17a-4f16-8e80-113ea968454e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a6459790>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:25.262722 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f08ba964-a17a-4f16-8e80-113ea968454e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 285 microversion: 2.1 time: 0.048431 Aug 29 23:59:25.263284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 425/875] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:25 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 285 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:25.273932 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e118410b-3c08-46e5-a092-3c34712aa9b2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a647ee50>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:25.313536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e118410b-3c08-46e5-a092-3c34712aa9b2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.043282 Aug 29 23:59:25.314121 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 426/876] 10.222.0.90 () {58 vars in 1140 bytes} [Mon Aug 29 23:59:25 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:25.326934 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c7cf579d-3bd1-4601-b8ca-82161102e783 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a63e6f70>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:25.365019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c7cf579d-3bd1-4601-b8ca-82161102e783 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 285 microversion: 2.1 time: 0.043134 Aug 29 23:59:25.365644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 427/877] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:25 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:25.476656 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-80c30517-cb5a-4e18-a99d-97c067cefb36 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments/6dcd514c-97f0-49a6-9631-2413347f75b7" status: 202 len: 0 microversion: 2.1 time: 0.500835 Aug 29 23:59:25.477173 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 451/878] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 23:59:24 2022] DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments/6dcd514c-97f0-49a6-9631-2413347f75b7 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:59:25.485900 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:25.488435 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:25.495566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:25.496063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:25.496530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:25.497251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:25.497706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:25.498128 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:25.535725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ef35f54a-1c84-4644-8827-193106650398 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053681 Aug 29 23:59:25.540380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 428/879] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:59:25 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:26.386971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5a6117f8-0cab-401c-865b-b41a08ee5685 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a6433af0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:26.454206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5a6117f8-0cab-401c-865b-b41a08ee5685 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 285 microversion: 2.1 time: 0.073390 Aug 29 23:59:26.454794 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 452/880] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:26 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 285 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:26.550043 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:26.553319 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:26.564109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:26.565037 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:26.565670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:26.566520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:26.566997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:26.567425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:26.605677 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4b821f21-9452-4237-9daf-62909fe7b778 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060190 Aug 29 23:59:26.606939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 429/881] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:59:26 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:27.468101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a62a4835-d39d-4992-b857-1c30f7add16a tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a64a5790>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:27.500766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a62a4835-d39d-4992-b857-1c30f7add16a tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 285 microversion: 2.1 time: 0.037423 Aug 29 23:59:27.501480 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 453/882] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:27 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:27.623265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:27.627368 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:27.632383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:27.632953 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:27.633422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:27.634122 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:27.634574 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:27.634994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:27.668888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ca76e3ac-1a79-45d5-9aec-abdefcb8b89a tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051419 Aug 29 23:59:27.669483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 430/883] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:59:27 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:28.518213 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c408f79a-bbca-4e21-8251-402227dbc0c0 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a63cc550>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:28.567328 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c408f79a-bbca-4e21-8251-402227dbc0c0 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 286 microversion: 2.1 time: 0.054842 Aug 29 23:59:28.568551 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 454/884] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:28 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:28.583752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-25167d3b-e994-47b6-b0e1-0a6c3f37f2a1 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a63b3a60>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:28.685081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:28.692101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:28.718955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:28.719669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:28.720358 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:28.721620 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:28.722622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:28.723439 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:28.781560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e83314df-38b9-4fd0-9558-c629c5adf26b tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102735 Aug 29 23:59:28.783210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 455/885] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:59:28 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:28.897356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-25167d3b-e994-47b6-b0e1-0a6c3f37f2a1 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 202 len: 0 microversion: 2.1 time: 0.319037 Aug 29 23:59:28.912806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 431/886] 10.222.0.90 () {58 vars in 1254 bytes} [Mon Aug 29 23:59:28 2022] DELETE /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:28.914973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a5b91de1-6834-4b2d-9349-bbde1a15bcf0 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a63541f0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:28.986766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a5b91de1-6834-4b2d-9349-bbde1a15bcf0 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 200 len: 285 microversion: 2.1 time: 0.079816 Aug 29 23:59:28.988043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 456/887] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:28 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:29.800926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:29.803080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:29.814445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:29.814942 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:29.815382 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:29.816132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:29.816621 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:29.817053 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:29.851089 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-565b97a9-b69a-4f12-8afd-3cc382df7e17 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054840 Aug 29 23:59:29.851672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 432/888] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 23:59:29 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:59:29.923701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:29.924308 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:29.930387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:29.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:29.932908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:29.934071 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:29.934612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:29.935233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:29.968052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:59:30.002834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-79062152-a7da-4953-b11e-cf0b37331fe2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a647e280>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:30.034271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-79062152-a7da-4953-b11e-cf0b37331fe2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] HTTP exception thrown: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-79062152-a7da-4953-b11e-cf0b37331fe2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Request method failure captured: Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf HTTP/1.1 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVLaHmgaPESd4eake7ruwP0twkroskGN8Z4K61n-QUxmrtqofNNTnUYJEcSBLRy3hD_t231vOfEjVILAMLSNh27l4xINXnHSCvAVRK9rv0oBMN7I7kugR-RLQM0CSZXwM43TBPnJGlBmyGICuSCwL5-oABJtl7CQKqB6GmYo1MxnSY0 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:30.036782 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a1e18ce8287c4a2db95014fafecff0a4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}] Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: fbd061fc3438400f9344b553c6a43a39 Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '8eb2cd86-ebed-4959-b93d-966ff35b63bf'} Aug 29 23:59:30.038396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. (HTTP 404) (Request-ID: req-4801e753-6c6e-4ef0-a0db-b599951fcf05) Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.039499 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:30.041147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 23:59:30.044561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-79062152-a7da-4953-b11e-cf0b37331fe2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Returning 404 to user: Snapshot 8eb2cd86-ebed-4959-b93d-966ff35b63bf could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:30.047039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-79062152-a7da-4953-b11e-cf0b37331fe2 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf" status: 404 len: 111 microversion: 2.1 time: 0.039952 Aug 29 23:59:30.048843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 433/889] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:29 2022] GET /compute/v2.1/os-snapshots/8eb2cd86-ebed-4959-b93d-966ff35b63bf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:30.053579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-83c158b3-7398-4a99-bf85-5f2d1c53de6d tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a641c8b0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:30.300838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c1b5cfad-6e0a-45e5-9a4e-ce09314be9bb tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 204 len: 0 microversion: 2.1 time: 0.380843 Aug 29 23:59:30.301617 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 457/890] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:29 2022] DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:59:30.311827 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-83c158b3-7398-4a99-bf85-5f2d1c53de6d tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 202 len: 0 microversion: 2.1 time: 0.265087 Aug 29 23:59:30.312681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:30.313378 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:30.315418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 434/891] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:30 2022] DELETE /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:30.320810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:30.320810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:30.321117 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:30.321778 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:30.322430 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:30.323679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:30.325559 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6ed2d8a0-4dfd-4cf1-a18e-909869a506f9 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a6459f70>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:30.427251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6ed2d8a0-4dfd-4cf1-a18e-909869a506f9 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 200 len: 345 microversion: 2.1 time: 0.110184 Aug 29 23:59:30.428678 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 435/892] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:30 2022] GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:30.518585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:30.530557 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d5ad1efa-1782-402f-99d6-319659149c25 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1682 microversion: 2.1 time: 0.223116 Aug 29 23:59:30.531751 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 458/893] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:30 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:31.444387 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e5a3aae-149c-4336-b287-1483dd203e7e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a647e040>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:31.480958 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-2e5a3aae-149c-4336-b287-1483dd203e7e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] HTTP exception thrown: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e5a3aae-149c-4336-b287-1483dd203e7e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Request method failure captured: Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf HTTP/1.1 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVLaHmgaPESd4eake7ruwP0twkroskGN8Z4K61n-QUxmrtqofNNTnUYJEcSBLRy3hD_t231vOfEjVILAMLSNh27l4xINXnHSCvAVRK9rv0oBMN7I7kugR-RLQM0CSZXwM43TBPnJGlBmyGICuSCwL5-oABJtl7CQKqB6GmYo1MxnSY0 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:31.482920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a1e18ce8287c4a2db95014fafecff0a4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}] Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: fbd061fc3438400f9344b553c6a43a39 Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'e94abcf5-f7ec-4c01-9156-b43edb17abaf'} Aug 29 23:59:31.484811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. (HTTP 404) (Request-ID: req-fea9d093-09c3-484b-933d-9dd8807cd389) Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.486624 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:31.488001 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:59:31.489402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e5a3aae-149c-4336-b287-1483dd203e7e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Returning 404 to user: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2e5a3aae-149c-4336-b287-1483dd203e7e tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 404 len: 109 microversion: 2.1 time: 0.045806 Aug 29 23:59:31.490726 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 436/894] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:31 2022] GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:31.498544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9bcb0e09-d95c-4be4-a249-cb3586f0fcf7 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a64a58b0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:31.531047 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-9bcb0e09-d95c-4be4-a249-cb3586f0fcf7 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] HTTP exception thrown: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9bcb0e09-d95c-4be4-a249-cb3586f0fcf7 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Request method failure captured: Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf HTTP/1.1 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVLaHmgaPESd4eake7ruwP0twkroskGN8Z4K61n-QUxmrtqofNNTnUYJEcSBLRy3hD_t231vOfEjVILAMLSNh27l4xINXnHSCvAVRK9rv0oBMN7I7kugR-RLQM0CSZXwM43TBPnJGlBmyGICuSCwL5-oABJtl7CQKqB6GmYo1MxnSY0 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:31.533203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a1e18ce8287c4a2db95014fafecff0a4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}] Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: fbd061fc3438400f9344b553c6a43a39 Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'e94abcf5-f7ec-4c01-9156-b43edb17abaf'} Aug 29 23:59:31.535254 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. (HTTP 404) (Request-ID: req-75fda174-a2ba-45f5-93bf-7436ee5a7295) Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.536513 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:59:31.538073 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:59:31.540461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9bcb0e09-d95c-4be4-a249-cb3586f0fcf7 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Returning 404 to user: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9bcb0e09-d95c-4be4-a249-cb3586f0fcf7 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 404 len: 109 microversion: 2.1 time: 0.042716 Aug 29 23:59:31.543559 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 459/895] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:31 2022] DELETE /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:31.545707 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7155cc24-7cf3-41ff-83d0-18f11fd72e42 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Calling method '.version_select at 0x7fd5a647e430>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:31.553615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:31.554244 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:31.566521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:31.567143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:31.567584 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:31.568498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:31.568962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:31.569401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:31.592076 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-7155cc24-7cf3-41ff-83d0-18f11fd72e42 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] HTTP exception thrown: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7155cc24-7cf3-41ff-83d0-18f11fd72e42 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Request method failure captured: Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf HTTP/1.1 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVLaHmgaPESd4eake7ruwP0twkroskGN8Z4K61n-QUxmrtqofNNTnUYJEcSBLRy3hD_t231vOfEjVILAMLSNh27l4xINXnHSCvAVRK9rv0oBMN7I7kugR-RLQM0CSZXwM43TBPnJGlBmyGICuSCwL5-oABJtl7CQKqB6GmYo1MxnSY0 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:31.594119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a1e18ce8287c4a2db95014fafecff0a4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a1e18ce8287c4a2db95014fafecff0a4"}]}] Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a1e18ce8287c4a2db95014fafecff0a4 Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1157752377 Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: fbd061fc3438400f9344b553c6a43a39 Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1157752377-project Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'e94abcf5-f7ec-4c01-9156-b43edb17abaf'} Aug 29 23:59:31.596257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. (HTTP 404) (Request-ID: req-b8666091-6876-474b-bd48-af80bd497016) Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.601808 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:31.602954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:59:31.609693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7155cc24-7cf3-41ff-83d0-18f11fd72e42 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] Returning 404 to user: Volume e94abcf5-f7ec-4c01-9156-b43edb17abaf could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7155cc24-7cf3-41ff-83d0-18f11fd72e42 tempest-VolumesSnapshotsTestJSON-1157752377 tempest-VolumesSnapshotsTestJSON-1157752377-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf" status: 404 len: 109 microversion: 2.1 time: 0.055151 Aug 29 23:59:31.612220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 437/896] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:31 2022] GET /compute/v2.1/os-volumes/e94abcf5-f7ec-4c01-9156-b43edb17abaf => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:31.762864 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:31.779542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-fa00302d-0d40-489a-8a29-be7a6cba72b9 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1682 microversion: 2.1 time: 0.229314 Aug 29 23:59:31.780624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 460/897] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:31 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:32.819837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:32.821172 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:32.848803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:32.852007 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:32.852903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:32.854622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:32.858028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:32.858835 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:33.173300 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:33.183230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e61b3823-65c4-49f4-b178-e644228b3453 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1682 microversion: 2.1 time: 0.367297 Aug 29 23:59:33.188217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 438/898] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:32 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:34.215504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:34.217120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:34.235137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:34.235796 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:34.237469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:34.242038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:34.242685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:34.243388 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:34.407181 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:34.426276 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-64af89b8-0edc-42fe-a964-6f5e81d2dbd0 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1615 microversion: 2.1 time: 0.224333 Aug 29 23:59:34.454036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa54094f-c31b-41ec-ab2d-2e80b4e30cfe", "name": "network-vif-deleted", "tag": "69e68088-d17f-4c25-8006-de53d82f4084"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:34.473615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 461/899] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:34 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1615 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:34.480432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:34.482315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:34.491638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:34.526821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] Creating event network-vif-deleted:69e68088-d17f-4c25-8006-de53d82f4084 for instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe on hv-cinder-85504 Aug 29 23:59:34.559141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d6c26194-21d3-44fd-939b-e2eb9395375b req-8362146d-0e89-4548-8b9c-7115d747be37 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096885 Aug 29 23:59:34.566271 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 439/900] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:35.481631 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:35.482880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:35.499845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:35.500380 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:35.500886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:35.503031 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:35.505461 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:35.505942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:35.571963 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:35.577722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:35.578398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:35.579043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lazy-loading 'fault' on Instance uuid fa54094f-c31b-41ec-ab2d-2e80b4e30cfe {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:35.678927 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829e698428cd4e9ca05aabb9c25c6fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2963b1b4aba47f593c63a398b511792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:35.691203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-12664b07-c511-4a50-a73e-4ddfdb66d656 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 200 len: 1331 microversion: 2.1 time: 0.213621 Aug 29 23:59:35.692379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 462/901] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:35 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 1331 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:36.717206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:36.717871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:36.726251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:36.726903 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:36.727540 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:36.729274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:36.730739 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:36.731832 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:36.747996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe HTTP/1.1 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:36.750032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:36.756761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'fa54094f-c31b-41ec-ab2d-2e80b4e30cfe'} Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:36.757758 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:36.759630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:36.762169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:36.762169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d7c5ffdb-511f-4ca9-bb94-893946341824 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 404 len: 111 microversion: 2.1 time: 0.041574 Aug 29 23:59:36.762169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 440/902] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:36 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:36.766924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5e7815a5-49fc-4fb1-8552-d720dfbe29b1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '.version_select at 0x7fd5a648e8b0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:36.874941 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5e7815a5-49fc-4fb1-8552-d720dfbe29b1 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305939954" status: 202 len: 0 microversion: 2.1 time: 0.115653 Aug 29 23:59:36.875634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 463/903] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 23:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305939954 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:37.645481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-57439e75-52ef-4c39-8cec-d5c442e4b768 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a63e1700>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:37.714891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-57439e75-52ef-4c39-8cec-d5c442e4b768 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e6dfb7d0-1ea4-4bdb-a369-a0459b069225" status: 200 len: 351 microversion: 2.1 time: 0.076441 Aug 29 23:59:37.715334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 441/904] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:37 2022] GET /compute/v2.1/os-volumes/e6dfb7d0-1ea4-4bdb-a369-a0459b069225 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:39.315024 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.315606 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:39.322289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:39.323520 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:39.324138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:39.324872 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:39.325328 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:39.325756 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:39.328638 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:39.341272 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe HTTP/1.1 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:39.342856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.345486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'fa54094f-c31b-41ec-ab2d-2e80b4e30cfe'} Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:39.346793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.349296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.351364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:39.351364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-97e41ef8-924f-422d-b77d-f11564d0471e tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 404 len: 111 microversion: 2.1 time: 0.033851 Aug 29 23:59:39.351364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 464/905] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:39 2022] DELETE /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:39.360553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.361164 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: fa54094f-c31b-41ec-ab2d-2e80b4e30cfe] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:39.376526 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:39.377108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:39.377685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:39.378420 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:39.378927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:39.379349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:39.400608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe HTTP/1.1 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:39.402284 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.403849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'fa54094f-c31b-41ec-ab2d-2e80b4e30cfe'} Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:39.404950 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. Aug 29 23:59:39.407362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:39.408860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance fa54094f-c31b-41ec-ab2d-2e80b4e30cfe could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:39.408860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6375870c-b85b-42ad-907d-8dfb6fb175bc tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe" status: 404 len: 111 microversion: 2.1 time: 0.048734 Aug 29 23:59:39.408860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 442/906] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:39 2022] GET /compute/v2.1/servers/fa54094f-c31b-41ec-ab2d-2e80b4e30cfe => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:39.642120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-91a2b78f-f331-4c90-bd3a-3bc0f3906a9d tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a66cf1f0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.710920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-91a2b78f-f331-4c90-bd3a-3bc0f3906a9d tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/c558c496-c13b-46d6-8b95-6a43846c42ec" status: 200 len: 351 microversion: 2.1 time: 0.076363 Aug 29 23:59:39.711484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 465/907] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:39 2022] GET /compute/v2.1/os-volumes/c558c496-c13b-46d6-8b95-6a43846c42ec => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:40.759802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:40.760710 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:40.769973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.776257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.776257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.776257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.776257 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.776655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.790174 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c HTTP/1.1 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:40.794067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.797098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'b35389dd-c528-4d6d-8519-fdb7a2d94c2c'} Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:40.798712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.801278 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.807144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:40.809219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-44aa46b1-cbbc-4fd3-a4d0-bf1d437162ae tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 404 len: 111 microversion: 2.1 time: 0.053014 Aug 29 23:59:40.815505 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 443/908] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:40 2022] DELETE /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:40.821170 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:40.822604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: b35389dd-c528-4d6d-8519-fdb7a2d94c2c] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:40.843707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.845357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.846042 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.847006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.848127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.848806 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.872815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c HTTP/1.1 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:40.874702 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.876081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'b35389dd-c528-4d6d-8519-fdb7a2d94c2c'} Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:40.876964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. Aug 29 23:59:40.878187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.881309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance b35389dd-c528-4d6d-8519-fdb7a2d94c2c could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:40.882459 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0f90fd0f-1bdb-493b-b5b5-562a61ddd234 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c" status: 404 len: 111 microversion: 2.1 time: 0.066305 Aug 29 23:59:40.883574 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 466/909] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:40 2022] GET /compute/v2.1/servers/b35389dd-c528-4d6d-8519-fdb7a2d94c2c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:40.895051 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:40.898919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:40.903619 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.904124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.904589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.905421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.905883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.906308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.922888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 HTTP/1.1 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:40.927956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.929367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '9887a44d-5fe2-4e65-aab4-5123e84fd9b6'} Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:40.930157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.931389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.934429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:40.934429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-27f7fd4e-035f-456f-9545-db85a378a206 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 404 len: 111 microversion: 2.1 time: 0.035935 Aug 29 23:59:40.934429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 444/910] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:40 2022] DELETE /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:40.936961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:40.937659 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 9887a44d-5fe2-4e65-aab4-5123e84fd9b6] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:40.944579 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.945441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.946137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.946957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:40.947766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:40.948298 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:40.967925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 HTTP/1.1 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:40.970137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.972217 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '9887a44d-5fe2-4e65-aab4-5123e84fd9b6'} Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:40.973118 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. Aug 29 23:59:40.974360 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:40.976462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 9887a44d-5fe2-4e65-aab4-5123e84fd9b6 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:40.977536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a1dc0764-3beb-4d46-87c7-3d6d3e3a1f48 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6" status: 404 len: 111 microversion: 2.1 time: 0.046714 Aug 29 23:59:40.982661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 467/911] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:40 2022] GET /compute/v2.1/servers/9887a44d-5fe2-4e65-aab4-5123e84fd9b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:41.731532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-701cfafc-2998-4b3f-bd0f-8fd7af8e0c2c tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a63e1700>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:41.814493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-701cfafc-2998-4b3f-bd0f-8fd7af8e0c2c tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/39003ee6-20b5-4cb0-b703-0544735dcdd7" status: 200 len: 351 microversion: 2.1 time: 0.080332 Aug 29 23:59:41.814493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 445/912] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:41 2022] GET /compute/v2.1/os-volumes/39003ee6-20b5-4cb0-b703-0544735dcdd7 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:41.823876 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6e97b890-2ec0-49c4-951b-5fef12716002 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a648e160>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:41.919684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6e97b890-2ec0-49c4-951b-5fef12716002 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.103228 Aug 29 23:59:41.922027 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 468/913] 10.222.0.90 () {58 vars in 1134 bytes} [Mon Aug 29 23:59:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:41.934865 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2c7dab55-7df3-4403-bea3-088683d5e4fe tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a9e4b430>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.085948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2c7dab55-7df3-4403-bea3-088683d5e4fe tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.154800 Aug 29 23:59:42.087011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 446/914] 10.222.0.90 () {58 vars in 1149 bytes} [Mon Aug 29 23:59:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:42.116637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-46b053ef-33d1-4729-b575-e76218adf313 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a6485820>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.239105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-46b053ef-33d1-4729-b575-e76218adf313 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.134451 Aug 29 23:59:42.239818 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 469/915] 10.222.0.90 () {58 vars in 1134 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:42.255220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-32ffccb5-316b-4e62-9c04-e610dade84ac tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a668b8b0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.359006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.359006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:42.365942 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:42.366516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:42.367005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:42.367937 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:42.368446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:42.368908 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:42.386381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 HTTP/1.1 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:42.388124 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.389812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '13772077-dc96-4813-925d-975c5748e4d1'} Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:42.395594 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.397169 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.398643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:42.398643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-40bae7e6-58a8-42b4-869c-b6ddefac5021 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 404 len: 111 microversion: 2.1 time: 0.037991 Aug 29 23:59:42.398643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 470/916] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 23:59:42 2022] DELETE /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:42.402537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.403313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] [instance: 13772077-dc96-4813-925d-975c5748e4d1] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:42.409090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-32ffccb5-316b-4e62-9c04-e610dade84ac tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.158111 Aug 29 23:59:42.410192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 447/917] 10.222.0.90 () {58 vars in 1167 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:42.411345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:42.411975 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:42.412507 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:42.413342 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:42.413946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:42.414516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:42.427864 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fcb4c518-89ac-4f28-9a56-f7e6e3db6da9 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a63e1670>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.434028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] HTTP exception thrown: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Request method failure captured: Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 HTTP/1.1 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVE6fqPtbWpZwRkMRf_7V2Su2XDRZxXziT8XcvGNBKixZS8mu7w6F3m-uh9PB6MY19nrnM9ywNhoso0IWcxR22junfLCTsPFRaVAZTZNU26MFE0Nhqs3-JLDuPy2ldZwUXmHCcr7mBwKV8JTOuEgdktHRSttO4ZYdJSMwByujD68OIw Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:42.435759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2963b1b4aba47f593c63a398b511792", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2963b1b4aba47f593c63a398b511792"}]}] Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: a2963b1b4aba47f593c63a398b511792 Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1805420495 Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 829e698428cd4e9ca05aabb9c25c6fb3 Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeNegativeTest-1805420495-project Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.437502 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '13772077-dc96-4813-925d-975c5748e4d1'} Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:42.438347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. Aug 29 23:59:42.439712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.440865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] Returning 404 to user: Instance 13772077-dc96-4813-925d-975c5748e4d1 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:42.440865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e4269174-2a0b-42b1-ac06-2b08284a7430 tempest-AttachVolumeNegativeTest-1805420495 tempest-AttachVolumeNegativeTest-1805420495-project] 10.222.0.90 "GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1" status: 404 len: 111 microversion: 2.1 time: 0.039762 Aug 29 23:59:42.440865 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 471/918] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/servers/13772077-dc96-4813-925d-975c5748e4d1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:42.576976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fcb4c518-89ac-4f28-9a56-f7e6e3db6da9 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.156641 Aug 29 23:59:42.577632 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 448/919] 10.222.0.90 () {58 vars in 1170 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:42.592319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-88e4c1ad-fef0-4576-8da9-447f4c2bcae6 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a640fe50>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.709482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-88e4c1ad-fef0-4576-8da9-447f4c2bcae6 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.121547 Aug 29 23:59:42.710053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 472/920] 10.222.0.90 () {58 vars in 1155 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:42.726888 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b7ed4db4-737d-4620-9930-c374e66d9fb1 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a641c8b0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.888599 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b7ed4db4-737d-4620-9930-c374e66d9fb1 tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.168434 Aug 29 23:59:42.889283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 449/921] 10.222.0.90 () {58 vars in 1188 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:42.906144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-25873d2b-9c33-4d66-a0b8-37bacfa5a1ab tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] Calling method '.version_select at 0x7fd5a648e0d0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:43.027647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-25873d2b-9c33-4d66-a0b8-37bacfa5a1ab tempest-VolumesTestJSON-76885908 tempest-VolumesTestJSON-76885908-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.126445 Aug 29 23:59:43.028249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 473/922] 10.222.0.90 () {58 vars in 1155 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:45.257843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:45.260647 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:45.262755 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=30 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:45.277157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.278145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.278761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:45.279788 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.280441 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.281215 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:45.341175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ccebe45c-9457-4be9-a3b1-c4853d51113f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.088038 Aug 29 23:59:45.343151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 450/923] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 23:59:45 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:45.454278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:45.461236 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:45.462183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.463892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.464624 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:45.465632 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.466343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.467260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:45.518821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:59:45.901537 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-5da140a3-2259-4060-b9f2-2cb133efc309 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 204 len: 0 microversion: 2.20 time: 0.451617 Aug 29 23:59:45.902504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 474/924] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:45 2022] DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:59:45.911285 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:45.912280 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:45.920197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.921032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.921636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:45.922375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:45.923015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:45.923451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:46.094163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:46.108821 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:46.110685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:46.112279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-804edb6b-66eb-4b57-8a9f-0cdde0827e1f tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.204808 Aug 29 23:59:46.113003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 451/925] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:45 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:47.136769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:47.137567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:47.149626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:47.156325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:47.156325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:47.156325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:47.158108 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:47.158830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:47.482983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:47.493212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:47.498750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:47.502851 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6d791cd7-a23d-410b-a990-04f217709c46 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1723 microversion: 2.20 time: 0.371498 Aug 29 23:59:47.506077 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 475/926] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:47 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:48.534103 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:48.534697 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:48.549519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:48.549908 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:48.550341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:48.551046 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:48.551498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:48.551918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:48.677771 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:48.689386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:48.693788 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:48.694907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5f1872ef-dc34-46ca-a260-2b5c21172de9 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1656 microversion: 2.20 time: 0.164936 Aug 29 23:59:48.695464 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 452/927] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:48 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:49.021474 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa", "name": "network-vif-deleted", "tag": "cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:49.033669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.035591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.035591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.052411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] Creating event network-vif-deleted:cbae01c4-9323-4ea8-b0bf-2ec8e2828b9f for instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa on hv-cinder-85504 Aug 29 23:59:49.060336 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-da28cbd2-5f5e-4d82-bc2b-6ab364cdd243 req-8b151521-6199-452f-b565-8e35164e132d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042481 Aug 29 23:59:49.070105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 476/928] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:49.721855 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:49.723039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:49.738622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.741998 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.749057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.752135 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.760534 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.761433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.815410 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.816349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.817345 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.818015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lazy-loading 'fault' on Instance uuid a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:49.889112 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:49.902867 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:49.905380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33926e50bce94a7e91fb2cd1a3071b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3beae764b5cb4dcd9f13e26878bbac48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:49.907145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-59e86aa6-bd0e-461f-beb2-8c5839cf7a12 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 200 len: 1370 microversion: 2.20 time: 0.190268 Aug 29 23:59:49.908156 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 453/929] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:49 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:51.007716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:51.007716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:51.007716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:51.007716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:51.011166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:51.011166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:51.011166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:51.011166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa HTTP/1.1 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:51.012162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:51.015352 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa'} Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:51.016969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:51.019612 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:51.022834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:51.022834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4fa0045a-b99a-4c7d-89ab-02a202c73ff4 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 404 len: 111 microversion: 2.20 time: 0.034330 Aug 29 23:59:51.022834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 477/930] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:51.024211 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2d1b40b5-a51b-40fb-8222-5fd853a07656 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '.version_select at 0x7fd5a9e4bdc0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:51.291477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2d1b40b5-a51b-40fb-8222-5fd853a07656 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989366422" status: 204 len: 0 microversion: 2.20 time: 0.279662 Aug 29 23:59:51.292230 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 454/931] 10.222.0.90 () {60 vars in 1259 bytes} [Mon Aug 29 23:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989366422 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 23:59:52.388977 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-dc1a837c-c280-4a73-bcf6-f14b41863613 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'create', calling method: .version_select at 0x7fd5a66cf160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2018617212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwkEOtpz4hda1H4JXAMHndVLgPIRI/tZBnDjItt4tYM9tGcrv1Iu8GfxV1VKxz2mMu+nLNl72TjNmbxj3A75Yg3IcMjXsPe37gWB1YvLNvwTDhLDz5EVr7r6FLiONAUUg=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:52.396391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:52.419691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-dc1a837c-c280-4a73-bcf6-f14b41863613 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Getting quotas for project f4188510da25496d956e4d717bc2a551. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:52.425517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-dc1a837c-c280-4a73-bcf6-f14b41863613 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Getting quotas for user 6415f8bc1e5646fe9951843d8ec41f0f and project f4188510da25496d956e4d717bc2a551. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:52.538828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-dc1a837c-c280-4a73-bcf6-f14b41863613 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.156240 Aug 29 23:59:52.538828 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 478/932] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 23:59:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:52.674744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-897455978", "imageRef": "cba9d22d-e20f-4bc8-903b-793e20d05070", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2018617212", "networks": [{"uuid": "b1780587-5845-4b44-80ee-36efef36f1d7"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:52.758449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] validate_networks() for [('b1780587-5845-4b44-80ee-36efef36f1d7', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:53.357509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:53.357981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:53.358451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:53.358860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:53.359273 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:53.371887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:53.377432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:53.377432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:53.377432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:53.377432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:53.377961 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:53.394930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Getting quotas for project f4188510da25496d956e4d717bc2a551. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:53.398916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Getting quotas for user 6415f8bc1e5646fe9951843d8ec41f0f and project f4188510da25496d956e4d717bc2a551. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:53.410408 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:53.412674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cba9d22d-e20f-4bc8-903b-793e20d05070',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:53.598580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1036ff02-e768-460c-9f33-994491542765 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928040 Aug 29 23:59:53.599582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 455/933] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 23:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:59:53.629554 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b19e661f-8ce6-4aed-9610-8e0009800d1f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:53.630119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b19e661f-8ce6-4aed-9610-8e0009800d1f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:53.714642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b19e661f-8ce6-4aed-9610-8e0009800d1f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.723324 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b19e661f-8ce6-4aed-9610-8e0009800d1f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1258 microversion: 2.1 time: 0.111434 Aug 29 23:59:53.736887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 479/934] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:53 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1258 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:54.046994 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:54.047517 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:54.053737 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.054313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.054870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.055655 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.056204 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.056698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.062520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:54.071433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa HTTP/1.1 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:54.073179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.075807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa'} Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:54.082352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.083560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.084800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:54.084800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e2c301ff-7114-4443-82db-090f819fca2b tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 404 len: 111 microversion: 2.20 time: 0.035106 Aug 29 23:59:54.084800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 456/935] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:54 2022] DELETE /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:54.085012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:54.085012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:54.091426 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.092012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.092493 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.093190 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.093685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.094106 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.109293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa HTTP/1.1 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:54.113026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.114544 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': 'a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa'} Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:54.115433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. Aug 29 23:59:54.116852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:54.118158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:54.118158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-31d4e4a5-ea00-422f-bc9f-c6a8bacf9078 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa" status: 404 len: 111 microversion: 2.20 time: 0.032771 Aug 29 23:59:54.118158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 480/936] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:54 2022] GET /compute/v2.1/servers/a6d1ed38-6f4f-42d8-8783-1ce03d19ddfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:54.745703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-35943c53-0f03-4e69-9afb-dafc1b998222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:54.746333 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-35943c53-0f03-4e69-9afb-dafc1b998222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:54.803557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-35943c53-0f03-4e69-9afb-dafc1b998222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:54.813804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-35943c53-0f03-4e69-9afb-dafc1b998222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1258 microversion: 2.1 time: 0.072588 Aug 29 23:59:54.814372 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 457/937] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:54 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:55.512020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.518458 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.519969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.520695 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.521131 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.521823 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.522279 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.522697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.537944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 HTTP/1.1 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 29 23:59:55.539509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.545434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '39819963-dd3d-4079-a0a1-d21a46d4a420'} Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:55.546175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.547385 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.550251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:55.550251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b071aa30-9890-4dfc-adef-9e16fdca315c tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 404 len: 111 microversion: 2.20 time: 0.033772 Aug 29 23:59:55.550251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 481/938] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:55 2022] DELETE /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:55.552768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.553442 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] [instance: 39819963-dd3d-4079-a0a1-d21a46d4a420] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.562817 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.563297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.563622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.564363 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.565098 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.565771 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.586736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] HTTP exception thrown: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Request method failure captured: Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 HTTP/1.1 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVFB2OIr1l0QOuoqSHnCUzQvBM3NCoIhn9Q8goVMsbKJbmboJbd5ZtULle357_cPIsi4TFFuZbo1PJgyM440Qm3Ath6bHb0bpnRgPhqsOr9wKJWJgq1FlEyALmWqBthZ8S9ZtqyYimSDGGs0GELpXoMLRN09kJUKvTlTAz0UvV2okoQ Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 29 23:59:55.588429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3beae764b5cb4dcd9f13e26878bbac48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3beae764b5cb4dcd9f13e26878bbac48"}]}] Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 3beae764b5cb4dcd9f13e26878bbac48 Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2146004435 Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 33926e50bce94a7e91fb2cd1a3071b73 Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2146004435-project Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.590747 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '39819963-dd3d-4079-a0a1-d21a46d4a420'} Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:55.591889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. Aug 29 23:59:55.593395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 29 23:59:55.594784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] Returning 404 to user: Instance 39819963-dd3d-4079-a0a1-d21a46d4a420 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:55.594784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-09147a90-6021-425d-9129-49f06e544a89 tempest-AttachVolumeShelveTestJSON-2146004435 tempest-AttachVolumeShelveTestJSON-2146004435-project] 10.222.0.90 "GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420" status: 404 len: 111 microversion: 2.20 time: 0.041914 Aug 29 23:59:55.594784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 458/939] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:55 2022] GET /compute/v2.1/servers/39819963-dd3d-4079-a0a1-d21a46d4a420 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:55.835412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.836407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.843411 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.844003 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.844464 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.845162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.846158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.852540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.911954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:55.921206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b719159b-5eec-4efd-873f-119818dda2cb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1254 microversion: 2.1 time: 0.089849 Aug 29 23:59:55.925848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 482/940] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:55 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:56.943846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:56.944466 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:56.951817 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.952341 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.952765 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.953455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.954051 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.954470 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.027866 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.038550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3e54331-f15b-4060-924a-77dd49d5f1c3 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1328 microversion: 2.1 time: 0.098966 Aug 29 23:59:57.053661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 459/941] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:56 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:58.083663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:58.089320 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:58.107150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.108566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.110413 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.114007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.114509 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.114947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.209737 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.218648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ff04d3c0-5c91-4541-94ed-1a3a80cae1b5 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1316 microversion: 2.1 time: 0.152087 Aug 29 23:59:58.221389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 483/942] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:58 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:59.243731 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:59.244502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:59.254031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.258158 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.258670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.262473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.262939 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.264792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.803933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.838596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-761557c9-411c-4f85-928d-235e4166dc54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.594859 Aug 29 23:59:59.838596 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 460/943] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:59 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:00.152287 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:00.178803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.179404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.181239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.220967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] Creating event network-changed:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:00:00.234749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-7a55f590-b66c-4d0a-b62f-968a69b3813d req-c52bc8ed-fdee-4fe1-ab50-0ff97e543147 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087952 Aug 30 00:00:00.239944 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 484/944] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:00.876768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:00.879088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:00.899825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.905147 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.906566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.907641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.909611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.925325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.273732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:01.291292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3a1cc6a1-be20-480f-8a85-84d6b4d9af83 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.437855 Aug 30 00:00:01.293805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 461/945] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:00 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:02.322022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:02.324691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:02.347465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.348222 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.348924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.363392 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.363943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.364567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.721490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:02.750879 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-deda6a11-caa6-4a7c-830b-999c8cb1896f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.433349 Aug 30 00:00:02.761565 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 485/946] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:02 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:03.789461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:03.790762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:03.794840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:03.804293 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.805177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.806074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.807177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.808401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.809299 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.104851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:04.114611 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ebbc5c6-e221-48aa-abb4-cc4443c0221e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.342866 Aug 30 00:00:04.115776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 462/947] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:03 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:05.159402 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:05.160204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:05.163649 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=6 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:05.178708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.181391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.181391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.182949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.204900 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.205660 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.485356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.496334 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1478569c-35fa-4120-9b88-9d927b68f845 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.342381 Aug 30 00:00:05.497424 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 486/948] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:05 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:06.528502 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:06.530045 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:06.536734 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=8 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:06.546949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.548767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.551016 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.552038 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.552912 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.553067 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.741706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:06.751385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-84efa858-ecee-495b-b5db-578f8482c74d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.229103 Aug 30 00:00:06.752980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 463/949] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:06 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:06.871961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-965495b3-c59d-42a8-afb9-46ca330b17b7 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Action: 'create', calling method: .version_select at 0x7fd5a6827790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-978424077", "metadata": {"Type": "work"}}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:07.775047 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:07.775684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:07.783214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.783749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.784205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.789811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.789811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.789811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.893547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-965495b3-c59d-42a8-afb9-46ca330b17b7 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.267262 Aug 30 00:00:07.894193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 487/950] 10.222.0.90 () {60 vars in 1156 bytes} [Tue Aug 30 00:00:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1269 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 00:00:07.907929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-239ac112-4435-4089-96cb-876ababcc5fa tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a653af70>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:07.961738 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.970976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-239ac112-4435-4089-96cb-876ababcc5fa tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 200 len: 352 microversion: 2.1 time: 0.066706 Aug 30 00:00:07.972305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 488/951] 10.222.0.90 () {58 vars in 1245 bytes} [Tue Aug 30 00:00:07 2022] GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:07.978227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-15ce5cd3-a7c8-4dcf-9fd8-9ad71133505f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.207289 Aug 30 00:00:07.979625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 464/952] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:07 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:08.988839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d79c99b7-c042-4a03-ade1-3a887fa42513 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a63720d0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.006410 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.007659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:09.015713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.016438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.017188 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.019919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.021052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.022813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.102775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d79c99b7-c042-4a03-ade1-3a887fa42513 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 200 len: 353 microversion: 2.1 time: 0.117789 Aug 30 00:00:09.102775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 489/953] 10.222.0.90 () {58 vars in 1245 bytes} [Tue Aug 30 00:00:08 2022] GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:09.120111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4a1084e1-60ca-4924-ab4c-ddb0b16d612c tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a640fc10>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.180886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4a1084e1-60ca-4924-ab4c-ddb0b16d612c tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 200 len: 353 microversion: 2.1 time: 0.064939 Aug 30 00:00:09.196393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 490/954] 10.222.0.90 () {58 vars in 1245 bytes} [Tue Aug 30 00:00:09 2022] GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:09.199651 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.208606 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0ca19d34-26fe-43e1-bf14-324820f5dfd9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.210668 Aug 30 00:00:09.211570 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 465/955] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:08 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:09.211688 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bc8642e1-7cfc-4b59-924e-debe2f58d772 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a64a0a60>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.478814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bc8642e1-7cfc-4b59-924e-debe2f58d772 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 202 len: 0 microversion: 2.1 time: 0.273450 Aug 30 00:00:09.479886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 491/956] 10.222.0.90 () {58 vars in 1248 bytes} [Tue Aug 30 00:00:09 2022] DELETE /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:00:09.491355 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bd0c976e-9947-44f1-afe2-f98917bc7ea6 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a63e13a0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.548162 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bd0c976e-9947-44f1-afe2-f98917bc7ea6 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 200 len: 352 microversion: 2.1 time: 0.060931 Aug 30 00:00:09.549252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 466/957] 10.222.0.90 () {58 vars in 1245 bytes} [Tue Aug 30 00:00:09 2022] GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:10.231801 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.232445 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:10.239227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.239722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.240227 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.240943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.241400 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.242009 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.438547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.446727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ebe62fab-7548-4faa-9c85-3fb2a2bd0222 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.219882 Aug 30 00:00:10.447329 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 492/958] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:10.564918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b2ab263-d164-4192-b240-bbfab5d3e455 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Calling method '.version_select at 0x7fd5a647e3a0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-1b2ab263-d164-4192-b240-bbfab5d3e455 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] HTTP exception thrown: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b2ab263-d164-4192-b240-bbfab5d3e455 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Request method failure captured: Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f HTTP/1.1 Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVMGXof2xtlfYoFcGKhs5HwFaYlf2r74LwTrLaqZj9inb9_kd8Ooq3QUIW3m8tdn29iCe_luqPYApZSoOtwwuhnwZhfuSuQn0oE2hdzbWmuaQtqUhVcE93VdSoHFIMayWL6vm_SG8Oq0vdOVwEuE_pUQGsCRYM0kyo0i352Vmv-tRns Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: d599baf7d9a84ff292f61fa552062cec Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesGetTestJSON-110096073 Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:00:10.621840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d599baf7d9a84ff292f61fa552062cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d599baf7d9a84ff292f61fa552062cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d599baf7d9a84ff292f61fa552062cec", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d599baf7d9a84ff292f61fa552062cec"}]}] Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesGetTestJSON-110096073 Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: d599baf7d9a84ff292f61fa552062cec Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesGetTestJSON-110096073 Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesGetTestJSON-110096073-project Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: b1a10b12f513437c898761a669899747 Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesGetTestJSON-110096073-project Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '6f0eb1e0-901e-41e6-8a44-45c21bad411f'} Aug 30 00:00:10.624309 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. (HTTP 404) (Request-ID: req-847677f3-d34e-4622-9529-4537b58cbdbb) Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:10.625380 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:00:10.626875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:00:10.628305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b2ab263-d164-4192-b240-bbfab5d3e455 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] Returning 404 to user: Volume 6f0eb1e0-901e-41e6-8a44-45c21bad411f could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1b2ab263-d164-4192-b240-bbfab5d3e455 tempest-VolumesGetTestJSON-110096073 tempest-VolumesGetTestJSON-110096073-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f" status: 404 len: 109 microversion: 2.1 time: 0.053576 Aug 30 00:00:10.629790 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 467/959] 10.222.0.90 () {58 vars in 1245 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/os-volumes/6f0eb1e0-901e-41e6-8a44-45c21bad411f => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:10.671048 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "name": "network-vif-plugged", "status": "completed", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:10.683404 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.683666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.683981 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.696050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] Creating event network-vif-plugged:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:00:10.703132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-213bac88-9dca-4071-aefc-a20faa2d09b1 req-3fd708ab-f1c9-4329-9588-8ef336a0ac96 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Aug 30 00:00:10.703958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 493/960] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:11.475780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.476638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.483911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.484639 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.485191 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.486022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.486583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.487253 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.675963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:11.682468 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-65fa6b33-ac41-40ca-91b3-974120b87781 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1358 microversion: 2.1 time: 0.214642 Aug 30 00:00:11.683151 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 468/961] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:12.704523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.705230 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.712049 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.712583 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.713016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.714453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.714934 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.715362 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.722596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:12.860808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.870156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-29527f90-6804-472d-aa31-4283000c6213 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1548 microversion: 2.1 time: 0.170024 Aug 30 00:00:12.879171 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 494/962] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:12.905461 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.906734 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.920839 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.921818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.922682 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.924008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.924935 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.925870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.099407 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.111072 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d45f2a99-586e-4c5e-bcde-009e3f138041 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1548 microversion: 2.1 time: 0.211657 Aug 30 00:00:13.111882 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 469/963] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1548 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:13.137681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.143014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.143929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Searching by: {'deleted': False, 'project_id': 'f4188510da25496d956e4d717bc2a551'} {{(pid=127669) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 00:00:13.152839 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.153332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.153770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.154529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.155016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.155642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.265897 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.multi_cell_list [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127669) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 00:00:13.400147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ae24215a-947a-4367-8311-121624215326 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.267388 Aug 30 00:00:13.400147 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 495/964] 10.222.0.90 () {58 vars in 1125 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:13.415772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.417235 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.426777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.427283 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.427718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.428447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.429209 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.430065 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.624385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.633662 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fed98f6a-3eda-44d5-83d0-0d2657d14ecd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1548 microversion: 2.1 time: 0.222073 Aug 30 00:00:13.634675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 470/965] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:16.005136 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0832825c-eed1-4011-87b0-b60dd57079ef"}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:16.007731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:16.014780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.015260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.015688 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.016408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.016856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.017386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.326064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-23c863d0-afcb-446f-a402-f48813ceb0dd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.324210 Aug 30 00:00:17.337115 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 496/966] 10.222.0.90 () {60 vars in 1323 bytes} [Tue Aug 30 00:00:15 2022] POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments => generated 194 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:25.510176 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.510804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.514314 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:25.514985 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=63 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:25.519916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.520451 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.520882 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.521580 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.522039 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.522485 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.674763 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.684838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1ead16a6-f0dd-4ef7-bda8-2dc9c2e81bfc tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1594 microversion: 2.1 time: 0.178793 Aug 30 00:00:25.685770 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 471/967] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:29.024062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:29.027541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:29.028607 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:29.413902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:29.427167 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.428529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.429143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.455701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] Creating event network-changed:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:00:29.464779 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-32f7e497-98de-413a-8f3e-efead3ee8abb req-e6d5cf00-aedd-4214-857f-db28ddf4325f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.442039 Aug 30 00:00:29.465383 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 497/968] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:32.741777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1149281320"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:32.742385 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:32.751826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:32.752362 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:32.752794 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:32.753493 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:32.754115 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:32.754897 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:32.944913 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.network.security_group_api [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Adding security group df59a32e-a28c-4ace-af13-bf069ecff8b0 to port 8da325df-4d82-44f1-9e8a-da503beb89d7 Aug 30 00:00:33.467785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-38cb01e3-7bca-4423-ace9-0985e3b4a8a4 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action" status: 202 len: 0 microversion: 2.1 time: 0.745384 Aug 30 00:00:33.468909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 472/969] 10.222.0.90 () {60 vars in 1278 bytes} [Tue Aug 30 00:00:32 2022] POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:00:33.489596 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:33.506229 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:33.506443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:33.506443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:33.506443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:33.506955 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:33.507405 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:33.507868 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:33.514130 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:33.520645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:33.522641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:33.523526 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:33.553100 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] Creating event network-changed:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:00:33.597157 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-6d022e56-0675-408e-9005-c970f2e286ae req-f4186a33-0335-439a-9e13-283690f2b5a1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104467 Aug 30 00:00:33.598485 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 473/970] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:00:33.745721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:33.757319 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9037b985-b7b8-4305-9b2a-b7ceb1402a82 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1760 microversion: 2.1 time: 0.283174 Aug 30 00:00:33.773930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 498/971] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:33 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1760 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:53.435240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:53.436054 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=12 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:53.440552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:53.442838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:53.449777 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.450261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.450818 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.451376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.451831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.452274 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.671168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ece8977e-b14c-4945-9ae0-3ac01248e73e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action" status: 202 len: 0 microversion: 2.1 time: 0.229407 Aug 30 00:00:53.671168 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 474/972] 10.222.0.90 () {60 vars in 1278 bytes} [Tue Aug 30 00:00:53 2022] POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:00:53.674976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:53.676146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:53.678497 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:53.684440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.685138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.685585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.686305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.686761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.687188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.843063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:53.851284 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-80d87261-31dc-4d67-9725-b797786a5ac0 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1752 microversion: 2.1 time: 0.183264 Aug 30 00:00:53.858034 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 499/973] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:53 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:54.874365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:54.875065 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:54.881296 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:54.881785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:54.882224 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:54.882925 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:54.883378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:54.883805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:55.040375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:55.053976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-24a22b64-a454-4991-be02-dce78a44bcda tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.184772 Aug 30 00:00:55.068616 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 475/974] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:54 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:56.079206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:56.079821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:56.086929 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.087449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.087885 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.088625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.089234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.089667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.253644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:56.262442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-97e82714-4d85-49d0-badf-aa1c7c116a7e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.187528 Aug 30 00:00:56.263556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 500/975] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:56 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:57.285438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:57.286438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:57.292582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:57.293066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:57.293507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:57.294332 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:57.295013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:57.295199 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:57.455233 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:57.463915 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9b63a93f-d463-41a2-a7ff-5b82180834b1 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.182509 Aug 30 00:00:57.464522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 476/976] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:57 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:58.485687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:58.486373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:58.492964 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.493401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.494040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:58.494983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.495716 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.496469 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:58.704651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:58.713240 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-44328e71-bc27-41a7-a8f5-da6d93fc4d08 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.231812 Aug 30 00:00:58.713833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 501/977] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:58 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:59.734545 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:59.735536 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:59.741359 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:59.741846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:59.742281 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:59.742980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:59.743430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:59.743850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:59.927829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:59.937132 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b7955987-3f90-4ef8-a952-2feb7bae71b9 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.207261 Aug 30 00:00:59.937693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 477/978] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:59 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:00.958681 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:00.959453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:00.965973 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.966753 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.967239 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:00.967933 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.968409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.968830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.123892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:01.134536 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7fa6430d-41aa-4787-b7bb-9d0e79fd0ade tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.179859 Aug 30 00:01:01.135846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 502/979] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:00 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:02.158819 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:02.159562 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:02.168608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.169850 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.171177 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.172087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.172698 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.173361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.377498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:02.389057 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4da6e5b7-b822-43ad-b21f-b9af022e06fd tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.234196 Aug 30 00:01:02.389645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 478/980] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:02 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:03.414052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:03.414777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:03.422140 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.422730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.423238 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:03.424127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.424685 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.425178 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:03.574468 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:03.588754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-92a772a9-cce7-4146-8865-63241d20d935 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.180166 Aug 30 00:01:03.589353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 503/981] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:03 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:04.610449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:04.611069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:04.618082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:04.618575 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:04.619009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.619789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:04.620356 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:04.620780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.772056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:04.780389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-879c67d0-3b9c-48d9-bcc8-ef3598b27fef tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.174172 Aug 30 00:01:04.780968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 479/982] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:04 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:05.805014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:05.805761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:05.812529 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.813105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.813637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.814407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.814957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.815454 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.968664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:05.977739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8f99453a-d65a-4b92-b488-a8ca4b29fc7d tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.178251 Aug 30 00:01:05.977739 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 504/983] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:05 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:06.999733 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:07.000398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:07.007061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.007548 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.007984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.008714 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.009170 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.009598 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.173360 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:07.181290 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-952afc98-619b-4347-9c56-4a630a78011e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.185890 Aug 30 00:01:07.181881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 480/984] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:06 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:08.208286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:08.208888 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:08.215371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.215862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.216312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.217810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.218384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.218808 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.399701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:08.408165 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-be0d1409-9536-4d33-adb9-e77726e32391 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.204231 Aug 30 00:01:08.408777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 505/985] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:08 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:09.434081 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:09.434721 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:09.444406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.445011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.445694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.446542 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.447074 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.447849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.621384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:09.630449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3c2210c2-9b09-4cff-9082-369117e099de tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.202493 Aug 30 00:01:09.631027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 481/986] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:09 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:10.652301 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:10.655407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:10.660253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.660731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.661155 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.661947 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.662396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.662810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.819484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:10.829007 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cdec3446-9a91-42d4-a279-d7b52fee0fca tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1757 microversion: 2.1 time: 0.180641 Aug 30 00:01:10.829589 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 506/987] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:10 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:11.851220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:11.851816 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:11.859386 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.859871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.860348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.861061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.861511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.861938 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.024581 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.040220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3e5f8e91-a609-46a5-80d6-0f2c6d7ae118 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1760 microversion: 2.1 time: 0.191058 Aug 30 00:01:12.040220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 482/988] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:11 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:36.773013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=16 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:36.774026 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=56 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:36.975896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-7827e6a0-d3fc-4dc0-a6c9-2ae98980b379 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Action: 'create', calling method: .version_select at 0x7fd5a648e5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1799128686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6JG1qUlX+jK4yaC/+uszGiRk0N3XGpCcYL0gR9bTuFQGOlBbJWrJZ+tGpAQm/2bHPbpjNSAzhz5s7KjJi3gHHuXQ+S6bzoUwzvhXGk0ZgPuzirdXNjKnEznbDMk1iLDw=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:36.995879 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-7827e6a0-d3fc-4dc0-a6c9-2ae98980b379 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:37.000542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-7827e6a0-d3fc-4dc0-a6c9-2ae98980b379 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for user eb54f68dbdc845f3aeb0d1661f531a0d and project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:37.112684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-7827e6a0-d3fc-4dc0-a6c9-2ae98980b379 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.344513 Aug 30 00:01:37.114133 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 507/989] 10.222.0.90 () {60 vars in 1159 bytes} [Tue Aug 30 00:01:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:50.919137 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1149281320"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:50.919785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:50.922143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=18 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.922812 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.928914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.929393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.929954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:50.930659 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.931150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.931583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.075004 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.network.security_group_api [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Removing security group df59a32e-a28c-4ace-af13-bf069ecff8b0 from port 8da325df-4d82-44f1-9e8a-da503beb89d7 Aug 30 00:01:51.468521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9c4619a7-0896-46b3-a576-4e825fdb710f tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action" status: 202 len: 0 microversion: 2.1 time: 0.552753 Aug 30 00:01:51.473494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 483/990] 10.222.0.90 () {60 vars in 1278 bytes} [Tue Aug 30 00:01:50 2022] POST /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:01:51.476904 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:51.482601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.483322 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.492148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.492736 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.493166 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.506410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] Creating event network-changed:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:01:51.517924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-cab0df49-7cbf-4c6b-97b7-4ee102d68ddb req-96213b0e-789f-4aca-a85a-014b21b368cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045396 Aug 30 00:01:51.532357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 508/991] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:52.987510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:52.992076 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:52.994829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.995702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.996145 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.997183 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.997646 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.998134 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.099198 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lazy-loading 'services' on Instance uuid ab5e7deb-a296-423d-97aa-15c678b3757d {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:53.332956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fadcd1b1-ecc6-41e9-8e90-15eae97b488c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments/0832825c-eed1-4011-87b0-b60dd57079ef" status: 202 len: 0 microversion: 2.1 time: 0.350513 Aug 30 00:01:53.339905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 484/992] 10.222.0.90 () {58 vars in 1416 bytes} [Tue Aug 30 00:01:52 2022] DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments/0832825c-eed1-4011-87b0-b60dd57079ef => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:01:53.346861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:53.349343 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:53.356533 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.366953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.366953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.366953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.366953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.367505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.400700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f7c4ab31-6f86-478a-b994-08df71ab6abb tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058817 Aug 30 00:01:53.400700 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 509/993] 10.222.0.90 () {58 vars in 1302 bytes} [Tue Aug 30 00:01:53 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:53.575174 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:53.586118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.586602 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.587034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.604860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] Creating event network-changed:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:01:53.610418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-542a8c49-a78d-4993-b84d-6e68a0dc7359 req-ff91d2aa-3ab1-484c-bdfa-93d7e89b0d56 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039188 Aug 30 00:01:53.612713 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 485/994] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:54.415548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.417852 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.424664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.425175 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.426045 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.426930 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.427489 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.427956 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.458251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9c70c4ff-f788-4897-adf3-c82858ea06f6 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047942 Aug 30 00:01:54.459004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 510/995] 10.222.0.90 () {58 vars in 1302 bytes} [Tue Aug 30 00:01:54 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:01:54.471181 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.471851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.478079 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.478641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.479110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.479796 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.480279 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.480703 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.557062 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] HTTP exception thrown: Instance ab5e7deb-a296-423d-97aa-15c678b3757d is not attached to volume 0832825c-eed1-4011-87b0-b60dd57079ef Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Request method failure captured: Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments/0832825c-eed1-4011-87b0-b60dd57079ef HTTP/1.1 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVLh0i-3JaFbEN8WldXjsZ98CzoZeMpAKOi5lytqNbX1JTDSpNx3swd2sm86msCFkjxOipe7YKmi--8i2Am9VfcazxEYrJQsZ4DMeykdBbTmdgnD5WsTXjhzc4TJBkRvmTKxgyO6o0TRfNXi_NgU0d9M0tt4934SGqFDCXlsEOsn8n4 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: f4188510da25496d956e4d717bc2a551 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:01:54.559760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f4188510da25496d956e4d717bc2a551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f4188510da25496d956e4d717bc2a551"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f4188510da25496d956e4d717bc2a551", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f4188510da25496d956e4d717bc2a551"}]}] Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: f4188510da25496d956e4d717bc2a551 Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestMinimumBasicScenario-1244578904-project Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 6415f8bc1e5646fe9951843d8ec41f0f Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestMinimumBasicScenario-1244578904-project Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:01:54.561495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance ab5e7deb-a296-423d-97aa-15c678b3757d is not attached to volume 0832825c-eed1-4011-87b0-b60dd57079ef Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'server_id': 'ab5e7deb-a296-423d-97aa-15c678b3757d', 'id': '0832825c-eed1-4011-87b0-b60dd57079ef'} Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0832825c-eed1-4011-87b0-b60dd57079ef. Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:54.562566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5e7deb-a296-423d-97aa-15c678b3757d is not attached to volume 0832825c-eed1-4011-87b0-b60dd57079ef Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5e7deb-a296-423d-97aa-15c678b3757d is not attached to volume 0832825c-eed1-4011-87b0-b60dd57079ef Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.564775 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Returning 404 to user: Instance ab5e7deb-a296-423d-97aa-15c678b3757d is not attached to volume 0832825c-eed1-4011-87b0-b60dd57079ef {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:54.565989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-72ba7d6f-8995-44c5-9fee-a9d4c08d0b54 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments/0832825c-eed1-4011-87b0-b60dd57079ef" status: 404 len: 154 microversion: 2.1 time: 0.095582 Aug 30 00:01:54.565989 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 486/996] 10.222.0.90 () {58 vars in 1416 bytes} [Tue Aug 30 00:01:54 2022] DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d/os-volume_attachments/0832825c-eed1-4011-87b0-b60dd57079ef => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:55.833290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:55.833798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:55.840451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:55.840943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:55.841381 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:55.842146 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:55.842610 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:55.843039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:55.871022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:56.218667 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-013d39e4-ba1c-4133-b385-a68e3c111a7a tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 204 len: 0 microversion: 2.1 time: 0.389996 Aug 30 00:01:56.219454 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 511/997] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:55 2022] DELETE /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:56.228304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:56.229108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:56.238013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.238854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.239601 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.240552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.241252 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.241871 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.665043 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.674102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3dd73d6c-10db-4096-9f39-dfa5f80a3493 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1554 microversion: 2.1 time: 0.449954 Aug 30 00:01:56.675240 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 487/998] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:56 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1554 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:57.138625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-30057780", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799128686", "security_groups": [{"name": "tempest-secgroup-smoke-1260045331"}], "block_device_mapping_v2": [{"uuid": "512f9b94-9321-492b-8f42-a13edb9ced07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79f758d9-f5c9-4dd1-ba1e-2857ef410b54"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:57.294517 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] validate_networks() for [('79f758d9-f5c9-4dd1-ba1e-2857ef410b54', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:57.694731 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:57.695159 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:57.695630 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:57.700114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:57.700854 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:57.704193 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:57.705304 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:57.713227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.714056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.714686 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.715634 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.715784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.716247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.716363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.716676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.716785 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.717475 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.718079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.718504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.749986 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:57.756061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for user eb54f68dbdc845f3aeb0d1661f531a0d and project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:57.833443 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:57.835903 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='512f9b94-9321-492b-8f42-a13edb9ced07',volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:57.905113 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.915960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3d79fa30-c516-479e-ae2a-bc095d31a00e tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1554 microversion: 2.1 time: 0.223960 Aug 30 00:01:57.929749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 488/999] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:57 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:58.361618 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8d4af1d2-bc8f-431b-8126-5f27f9e74ac9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.226891 Aug 30 00:01:58.363669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 512/1000] 10.222.0.90 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:01:58.373723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c683b84b-d6f0-46e1-92b1-4c5010fc0ecf tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:58.374560 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c683b84b-d6f0-46e1-92b1-4c5010fc0ecf tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:58.435721 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c683b84b-d6f0-46e1-92b1-4c5010fc0ecf tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.449031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c683b84b-d6f0-46e1-92b1-4c5010fc0ecf tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1093 microversion: 2.1 time: 0.075429 Aug 30 00:01:58.449031 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 489/1001] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:58 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:58.835801 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5e7deb-a296-423d-97aa-15c678b3757d", "name": "network-vif-deleted", "tag": "8da325df-4d82-44f1-9e8a-da503beb89d7"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:58.847161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.847648 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.848078 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.859534 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] Creating event network-vif-deleted:8da325df-4d82-44f1-9e8a-da503beb89d7 for instance ab5e7deb-a296-423d-97aa-15c678b3757d on hv-cinder-85504 Aug 30 00:01:58.865711 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-0a6f299b-01e4-4d66-821c-9136afe80394 req-ffd0e093-cd9b-4cd2-9abe-d36f183460c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Aug 30 00:01:58.866270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 513/1002] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:58.937633 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:58.941120 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:58.946175 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.946608 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.947144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.947849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.948342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.948770 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.022477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415f8bc1e5646fe9951843d8ec41f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4188510da25496d956e4d717bc2a551', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.031813 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c67d81b6-f584-41b6-a59f-a86e3f4e1968 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 200 len: 1512 microversion: 2.1 time: 0.098291 Aug 30 00:01:59.040458 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 490/1003] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:58 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:59.471081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d1083ae4-9f0d-48e8-b870-c4f0a30671e9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:59.471738 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d1083ae4-9f0d-48e8-b870-c4f0a30671e9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:59.535650 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d1083ae4-9f0d-48e8-b870-c4f0a30671e9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.543179 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d1083ae4-9f0d-48e8-b870-c4f0a30671e9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1093 microversion: 2.1 time: 0.077558 Aug 30 00:01:59.544932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 514/1004] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:59 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:00.061597 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.063166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] [instance: ab5e7deb-a296-423d-97aa-15c678b3757d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:00.071883 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.072885 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.073450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.074343 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.075226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.075668 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.092829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] HTTP exception thrown: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Request method failure captured: Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d HTTP/1.1 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVLh0i-3JaFbEN8WldXjsZ98CzoZeMpAKOi5lytqNbX1JTDSpNx3swd2sm86msCFkjxOipe7YKmi--8i2Am9VfcazxEYrJQsZ4DMeykdBbTmdgnD5WsTXjhzc4TJBkRvmTKxgyO6o0TRfNXi_NgU0d9M0tt4934SGqFDCXlsEOsn8n4 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: f4188510da25496d956e4d717bc2a551 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:02:00.094676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f4188510da25496d956e4d717bc2a551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f4188510da25496d956e4d717bc2a551"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f4188510da25496d956e4d717bc2a551", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f4188510da25496d956e4d717bc2a551"}]}] Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: f4188510da25496d956e4d717bc2a551 Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244578904 Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestMinimumBasicScenario-1244578904-project Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 6415f8bc1e5646fe9951843d8ec41f0f Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestMinimumBasicScenario-1244578904-project Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. Aug 30 00:02:00.097391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': 'ab5e7deb-a296-423d-97aa-15c678b3757d'} Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:02:00.098268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. Aug 30 00:02:00.099768 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:02:00.101352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Returning 404 to user: Instance ab5e7deb-a296-423d-97aa-15c678b3757d could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:02:00.101352 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6cc39eaa-a936-4826-968f-97b28fca878c tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d" status: 404 len: 111 microversion: 2.1 time: 0.041077 Aug 30 00:02:00.102614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 491/1005] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:00 2022] GET /compute/v2.1/servers/ab5e7deb-a296-423d-97aa-15c678b3757d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:02:00.114190 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d0c91182-8144-4db6-be97-3cf68bd93627 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] Calling method '.version_select at 0x7fd5a66cfb80>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.225293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d0c91182-8144-4db6-be97-3cf68bd93627 tempest-TestMinimumBasicScenario-1244578904 tempest-TestMinimumBasicScenario-1244578904-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2018617212" status: 202 len: 0 microversion: 2.1 time: 0.116321 Aug 30 00:02:00.226243 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 515/1006] 10.222.0.90 () {58 vars in 1272 bytes} [Tue Aug 30 00:02:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2018617212 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:02:00.565640 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.566681 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:00.576615 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.576968 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.577422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.578082 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.578528 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.585400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.685201 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:00.697036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4e761203-0e78-4f1e-8073-aa34878d099f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1191 microversion: 2.1 time: 0.135226 Aug 30 00:02:00.705789 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 492/1007] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:00 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:01.721658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:01.724039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:01.729767 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:01.730270 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:01.730712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:01.731418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:01.731880 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:01.732332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:01.801530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:01.809477 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-53ea6396-1fff-4610-9020-1d7b9928fe96 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1209 microversion: 2.1 time: 0.092453 Aug 30 00:02:01.810065 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 516/1008] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:01 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:02.835967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:02.836761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:02.843261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.844036 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.844686 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.846455 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.847160 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.847927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.111241 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.124523 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1894c6d9-cab6-40e4-a413-e01981176a97 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.290273 Aug 30 00:02:03.136324 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 493/1009] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:02 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:03.700540 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15195999-d4a4-4d69-a4f5-385d63adc174", "tag": "fb420043-338d-42f6-bb56-ac5a58f4c51d"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:03.715079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.719038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.719038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.731775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] Creating event network-changed:fb420043-338d-42f6-bb56-ac5a58f4c51d for instance 15195999-d4a4-4d69-a4f5-385d63adc174 on hv-cinder-85504 Aug 30 00:02:03.739072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-1842575e-27b8-4b29-8297-e9835d388255 req-69f5ac69-78c2-4124-8973-a2dcbb0e671b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043489 Aug 30 00:02:03.740924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 517/1010] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:04.150320 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:04.151697 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:04.160440 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.160941 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.161375 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.162087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.168444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.169428 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.896447 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.904641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c11cc078-e595-4571-ab3b-7bde2e6fa331 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.758059 Aug 30 00:02:04.905442 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 494/1011] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:04 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:05.928286 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:05.929142 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:05.942277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.945652 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.946161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.949506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.950626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.951332 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:06.230558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:06.243723 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6152b4fc-5baf-40b2-85dd-02a06c2990d3 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.320757 Aug 30 00:02:06.245120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 518/1012] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:05 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:07.266202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:07.268268 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:07.278723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.278723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.278723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.278723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.280452 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.285650 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.647444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.656050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0dc55649-7d3a-4c87-9e11-5410dc615a3b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.393954 Aug 30 00:02:07.656836 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 495/1013] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:07 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:08.679182 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:08.680012 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:08.687403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:08.689979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.690471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.690995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.691921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.692595 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.693212 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.254137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.283804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a38387bb-5a29-43e3-9fdd-b5300b105c19 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.607799 Aug 30 00:02:09.304391 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 519/1014] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:08 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:10.316754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:10.317483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:10.321195 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.325389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.325891 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.326325 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.328227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.328830 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.329248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.716843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:10.726399 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fed908c2-4c03-420c-9546-444eddbf80dd tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.413658 Aug 30 00:02:10.727006 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 496/1015] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:10 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:11.349293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=8 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.647373 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-13014888-6864-4f54-995a-e2f3f9ca3006 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Action: 'create', calling method: .version_select at 0x7fd5a65d7b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-615395356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzcsPts6PreZ3y2Gn2ennXlIrWdU0oUF/uo3jKv9FvReoEUIYCeQx3fuFV9VnhZb2uEgtDiIJPN5pwb4Sin5sUpbI/48ROJt4ze+uWQA9tk1Kg1XEdPBH/eEHHGIlv94w=="}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:11.677800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-13014888-6864-4f54-995a-e2f3f9ca3006 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Getting quotas for project 25d9f13fb1af4c3a911d91561bf0aae5. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:11.682578 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-13014888-6864-4f54-995a-e2f3f9ca3006 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Getting quotas for user 9d056d23a1a041f99c0afcc45fef323b and project 25d9f13fb1af4c3a911d91561bf0aae5. Resources: {'key_pairs'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:11.749050 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:11.749949 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:11.756849 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.757340 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.757805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.758511 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.758967 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.759389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.891982 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-13014888-6864-4f54-995a-e2f3f9ca3006 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.550256 Aug 30 00:02:11.895867 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 520/1016] 10.222.0.90 () {60 vars in 1159 bytes} [Tue Aug 30 00:02:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:11.912723 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.921792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d4f64f1e-67b5-483f-83b3-dcc5aaf7e85b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.176578 Aug 30 00:02:11.926090 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 497/1017] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:11 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:12.945634 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:12.947384 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:12.979754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.979754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.979754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.979754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.980224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.980224 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:13.140590 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:13.166510 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-20c895ba-6497-46db-b417-f66058e59104 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.224453 Aug 30 00:02:13.167523 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 521/1018] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:12 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:14.000125 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15195999-d4a4-4d69-a4f5-385d63adc174", "name": "network-vif-plugged", "status": "completed", "tag": "fb420043-338d-42f6-bb56-ac5a58f4c51d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:14.011109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.011593 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.012021 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.024009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] Creating event network-vif-plugged:fb420043-338d-42f6-bb56-ac5a58f4c51d for instance 15195999-d4a4-4d69-a4f5-385d63adc174 on hv-cinder-85504 Aug 30 00:02:14.029751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-879f7361-6001-4283-81d4-2e40ec953a89 req-a313ba64-4aea-4b8f-ae90-0c7d512b5b7b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Aug 30 00:02:14.030344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 498/1019] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:14.190091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:14.190793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:14.197770 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.198338 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.198846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.200725 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.201449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.202119 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.362428 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.371043 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cb16d3d2-d21f-46d4-907e-636d6ea2939f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.185600 Aug 30 00:02:14.371824 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 522/1020] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:14 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:15.393260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:15.394073 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:15.403480 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.404192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.404736 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.405532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.406052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.406671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.619246 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:15.628588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f6002404-3b44-485f-b950-a490b208e6b6 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1265 microversion: 2.1 time: 0.240937 Aug 30 00:02:15.629187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 499/1021] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:15 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:16.654957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:16.655564 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:16.663468 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.664001 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.668995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.668995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.668995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.668995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.810911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:16.819504 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e5381ec6-30f1-4acd-a277-6ceb12d3db38 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1451 microversion: 2.1 time: 0.168423 Aug 30 00:02:16.820314 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 523/1022] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:16 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:16.843418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:16.844024 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:16.852342 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.852840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.853277 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.853980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.854436 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.854862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.998335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.007389 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a17666d8-72b5-47a9-9dd0-9eb0df71676e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1451 microversion: 2.1 time: 0.167837 Aug 30 00:02:17.007964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 500/1023] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:16 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:19.580096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15195999-d4a4-4d69-a4f5-385d63adc174", "tag": "fb420043-338d-42f6-bb56-ac5a58f4c51d"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:19.590604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:19.591371 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:19.591844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:19.604020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] Creating event network-changed:fb420043-338d-42f6-bb56-ac5a58f4c51d for instance 15195999-d4a4-4d69-a4f5-385d63adc174 on hv-cinder-85504 Aug 30 00:02:19.609572 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-9adb749b-396c-4771-bafd-a4b185314147 req-2da5134e-3b8c-48ae-b931-2771e70ff74b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033390 Aug 30 00:02:19.610278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 524/1024] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:30.707301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-14379133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-615395356", "security_groups": [{"name": "tempest-secgroup-smoke-580491424"}], "networks": [{"uuid": "8f166cb4-c4bf-43cb-8e53-808a94ef3b22"}], "block_device_mapping_v2": [{"uuid": "1e9fe317-9c7c-4231-bdab-a0bf80127f13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:30.718088 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=38 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:30.718859 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:30.825288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] validate_networks() for [('8f166cb4-c4bf-43cb-8e53-808a94ef3b22', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:02:31.208826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:02:31.209254 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:02:31.209728 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:02:31.210141 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:02:31.210550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:02:31.219220 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.219700 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.220138 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.220892 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.221347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.221774 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.240429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Getting quotas for project 25d9f13fb1af4c3a911d91561bf0aae5. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:31.244463 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Getting quotas for user 9d056d23a1a041f99c0afcc45fef323b and project 25d9f13fb1af4c3a911d91561bf0aae5. Resources: {'ram', 'instances', 'cores'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:31.303130 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:02:31.305417 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e9fe317-9c7c-4231-bdab-a0bf80127f13',volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:02:31.705059 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5b626b61-161c-4c4d-b1cb-83c561e45f38 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.002090 Aug 30 00:02:31.705705 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 501/1025] 10.222.0.90 () {60 vars in 1147 bytes} [Tue Aug 30 00:02:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:02:31.717542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a3f28756-88ce-40ad-b1ea-85e80733e7bd tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:31.718382 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a3f28756-88ce-40ad-b1ea-85e80733e7bd tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:31.720922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=4 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.721698 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.722846 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.777176 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a3f28756-88ce-40ad-b1ea-85e80733e7bd tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:31.784495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a3f28756-88ce-40ad-b1ea-85e80733e7bd tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1086 microversion: 2.1 time: 0.071146 Aug 30 00:02:31.785749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 525/1026] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:31 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:32.806108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:32.806763 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:32.813778 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.814288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.814693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.815364 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.815812 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.816547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.878948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:32.886960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9d8895ab-c240-4747-ae36-e10b416f2c70 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1136 microversion: 2.1 time: 0.085386 Aug 30 00:02:32.887524 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 502/1027] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:32 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:33.911487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:33.912750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:33.927813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:33.928740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:33.929499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:33.930714 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:33.931535 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:33.932328 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:34.007679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:34.015750 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-be15d442-6256-4320-9e73-a810b61c4ab7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1192 microversion: 2.1 time: 0.111566 Aug 30 00:02:34.016600 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 526/1028] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:33 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:35.039328 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:35.040674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:35.043288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:02:35.043469 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Tue Aug 30 00:02:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 (ip 10.222.0.90) !!! Aug 30 00:02:35.062744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:35.062744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:35.062744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:35.062744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:35.063250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:35.063250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:35.363876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:35.372761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ea756cd-23d9-4de2-962e-f74f590c2178 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1269 microversion: 2.1 time: 0.337542 Aug 30 00:02:35.374077 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 503/1029] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:35 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1269 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:35.824367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:35.836465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:35.837017 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:35.837462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:35.851425 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] Creating event network-changed:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:02:35.856976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-cc99b419-a9c0-4ddc-b363-12076a6600a3 req-b4c7f616-2728-4fe5-a26b-ac4815819beb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037988 Aug 30 00:02:35.857902 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 527/1030] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:36.410108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:36.410961 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:36.417749 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:36.418695 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:36.419482 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:36.420202 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:36.420671 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:36.421084 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:36.554909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:36.563657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b891c637-fd3d-495e-b6e7-89892522c5e7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.158319 Aug 30 00:02:36.564259 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 504/1031] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:36 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:37.592228 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:37.592842 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:37.600636 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:37.601149 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:37.602976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:37.603677 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:37.604231 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:37.604943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:37.810116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:37.818651 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1fa62151-2a23-474b-a0fd-ea2d08e28ce7 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.231681 Aug 30 00:02:37.819164 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 528/1032] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:37 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:38.840000 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:38.840696 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:38.847965 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:38.865974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:38.865974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:38.865974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:38.865974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:38.866494 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:38.986465 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:38.994986 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3fb9f82-9e71-4828-b69d-12ddbb70101f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.158963 Aug 30 00:02:38.995557 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 505/1033] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:38 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:40.015422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:40.016101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:40.023258 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:40.023779 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:40.024245 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:40.024959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:40.025416 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:40.025840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:40.173456 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:40.181793 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-62c38c5f-c428-4b3e-8ba1-e436548eb586 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.170311 Aug 30 00:02:40.182389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 529/1034] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:40 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:41.202974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:41.203605 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:41.211139 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:41.211630 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:41.212092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:41.212825 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:41.213272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:41.213693 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:41.232504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.251180 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.348519 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:41.356541 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9a2d385c-5f3e-4ac7-84af-514dfeb622d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.157510 Aug 30 00:02:41.357114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 506/1035] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:41 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:42.376866 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:42.377471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:42.380058 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.385432 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:42.385915 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:42.386350 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:42.387050 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:42.387499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:42.387916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:42.539011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:42.547220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-cb070fe2-4d6a-4939-b33c-1c17ec65e4e0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.174182 Aug 30 00:02:42.547802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 530/1036] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:42 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:43.569212 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:43.569869 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:43.576766 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:43.577263 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:43.577702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:43.578411 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:43.578875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:43.579301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:43.749178 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:43.757876 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-07ef2f0b-f7bc-4ff8-8de3-d96c426f6a1d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.192946 Aug 30 00:02:43.758576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 507/1037] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:43 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:44.782292 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:44.782863 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:44.790748 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:44.791233 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:44.791666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:44.792435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:44.792887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:44.793312 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:44.933232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:44.941313 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9ef46dba-10cb-4855-8f80-4dc69853b035 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.162911 Aug 30 00:02:44.941901 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 531/1038] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:44 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:45.883805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "name": "network-vif-plugged", "status": "completed", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:45.895653 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:45.896205 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:45.897108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:45.910561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] Creating event network-vif-plugged:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:02:45.916874 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-475a604f-0b8a-4a4f-a47b-9a35822dfc40 req-66921f29-ffd9-4136-8c24-d9a3ad7e403f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038600 Aug 30 00:02:45.917496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 508/1039] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:45.965800 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:45.966614 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:45.973389 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:45.974526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:45.974526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:45.975642 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:45.976114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:45.976571 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:46.145579 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:46.154754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-249d88bb-0804-4e72-883a-c1357c4b7796 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.192951 Aug 30 00:02:46.163853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 532/1040] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:45 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:47.177670 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:47.179034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:47.185520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:47.186011 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:47.186448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:47.187153 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:47.187609 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:47.188035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:47.327985 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:47.336425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dbf4da24-b3b5-45e2-9ea1-b4ceb318355a tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1257 microversion: 2.1 time: 0.163306 Aug 30 00:02:47.337014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 509/1041] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:47 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:48.357167 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:48.357708 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:48.364759 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.365817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.366281 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.367325 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.367815 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.368347 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.520952 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:48.530707 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-3ec712b9-b6af-48f2-83f3-0e67ee1e10d3 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1441 microversion: 2.1 time: 0.177443 Aug 30 00:02:48.531296 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 533/1042] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:48 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1441 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:48.551400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:48.551999 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:48.558773 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.559270 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.559676 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.560402 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.560851 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.561267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.706665 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:48.715846 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-28af5b6d-1280-448f-9a5f-3f0306dd252c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1441 microversion: 2.1 time: 0.168139 Aug 30 00:02:48.716477 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 510/1043] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:48 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:51.346521 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:51.365455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:51.366309 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:51.367063 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:51.382671 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] Creating event network-changed:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:02:51.387948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-c1b0ded7-6ef9-4d72-b5e2-453dd1ca2ec0 req-7fefe521-5069-4de3-8f5d-871993890203 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047352 Aug 30 00:02:51.388586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 534/1044] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:15.785347 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:15.786243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=52 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:15.790691 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:15.791174 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:15.798102 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:15.800760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:15.800760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:15.800760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:15.800760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:15.801165 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:15.829384 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:04:16.199644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6c81f219-22aa-40d8-b06c-20ba1e848feb tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "DELETE /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 204 len: 0 microversion: 2.1 time: 0.415932 Aug 30 00:04:16.200829 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 511/1045] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:04:15 2022] DELETE /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:04:16.208420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=22 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:16.209498 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=46 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:16.214283 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:16.215028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:16.222752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:16.223234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:16.223675 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:16.224396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:16.224854 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:16.225273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:16.368609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:16.377129 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8652cc28-30aa-4b8a-945c-69ffa28cbbf9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1576 microversion: 2.1 time: 0.171194 Aug 30 00:04:16.377776 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 535/1046] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:16 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:17.403907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:17.404636 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:17.412378 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:17.412862 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:17.413292 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:17.413981 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:17.414427 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:17.414845 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:17.552058 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:17.560767 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3a461a6-42f6-4684-a608-a1ecad4d776a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1576 microversion: 2.1 time: 0.161104 Aug 30 00:04:17.561418 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 512/1047] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:17 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:18.582156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:18.582763 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:18.589085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:18.589576 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:18.590016 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:18.590744 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:18.591420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:18.591843 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:18.674757 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:18.683091 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-8a61c586-0cbf-4b66-ab34-b8d2ffd468c4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1508 microversion: 2.1 time: 0.105030 Aug 30 00:04:18.683678 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 536/1048] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:18 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1508 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:18.781448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15195999-d4a4-4d69-a4f5-385d63adc174", "name": "network-vif-deleted", "tag": "fb420043-338d-42f6-bb56-ac5a58f4c51d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:18.799144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:18.800852 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:18.801401 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:18.816718 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] Creating event network-vif-deleted:fb420043-338d-42f6-bb56-ac5a58f4c51d for instance 15195999-d4a4-4d69-a4f5-385d63adc174 on hv-cinder-85504 Aug 30 00:04:18.822364 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a36f536c-c555-44af-a1a3-a463d0c0ca38 req-f49b7378-931f-453c-b7ef-553ce32183e6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111505 Aug 30 00:04:18.823060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 513/1049] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:19.706833 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:19.707732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:19.714203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.714689 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.715251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.716323 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.716870 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.717290 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.751148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.751591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.752031 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.752516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lazy-loading 'fault' on Instance uuid 15195999-d4a4-4d69-a4f5-385d63adc174 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:19.800968 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:19.809122 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d43b59aa-9bef-45f9-8402-71187e5c1e50 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 200 len: 1229 microversion: 2.1 time: 0.106093 Aug 30 00:04:19.810450 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 537/1050] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:19 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:20.833060 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:20.833658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:20.839886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:20.840412 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:20.841706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:20.842421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:20.842877 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:20.843306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:20.857811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] HTTP exception thrown: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Request method failure captured: Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 HTTP/1.1 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVNZjscV9Od6BGW2t-Gw2pig4Mxjdlw_52oVapu5etQoT_t9_oJeNINBIjEopkoJFu_hQ03o_ZRaYvRCXePozz7ghngNIOSS_3bcS4aepvDv1CWGKoYuuZjx5e4h5RMbLf5G5EH9vDnbp-dgsPPFoSUEtcIAFzY06UQ4uDiOMO9GOPI Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:04:20.861997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6e1e7c36165f47ad838bb6b42f3179d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}] Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: eb54f68dbdc845f3aeb0d1661f531a0d Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:04:20.863922 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '15195999-d4a4-4d69-a4f5-385d63adc174'} Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:20.864853 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:04:20.866419 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:04:20.867828 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Returning 404 to user: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:20.867828 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ae320f6-c6f1-4765-a339-3f827df63244 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 404 len: 111 microversion: 2.1 time: 0.033124 Aug 30 00:04:20.867828 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 514/1051] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:20 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:20.966680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1343348685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799128686", "security_groups": [{"name": "tempest-secgroup-smoke-1260045331"}], "block_device_mapping_v2": [{"uuid": "512f9b94-9321-492b-8f42-a13edb9ced07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79f758d9-f5c9-4dd1-ba1e-2857ef410b54"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:21.081467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] validate_networks() for [('79f758d9-f5c9-4dd1-ba1e-2857ef410b54', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:04:21.518011 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:04:21.518429 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:04:21.518904 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:04:21.519339 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:04:21.519752 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:04:21.529101 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.529603 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.530021 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.530747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.531209 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.531635 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.548158 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:04:21.552116 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for user eb54f68dbdc845f3aeb0d1661f531a0d and project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:04:21.612247 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:04:21.614379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='512f9b94-9321-492b-8f42-a13edb9ced07',volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:04:22.022954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0cb68ac7-02d7-4ccb-ab94-d95e9e8baa63 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.060850 Aug 30 00:04:22.023686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 538/1052] 10.222.0.90 () {60 vars in 1147 bytes} [Tue Aug 30 00:04:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:04:22.034427 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f9b85c04-7b46-4c60-ba18-de3c73c2a4e7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:22.035038 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f9b85c04-7b46-4c60-ba18-de3c73c2a4e7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:22.090926 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9b85c04-7b46-4c60-ba18-de3c73c2a4e7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:22.101761 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f9b85c04-7b46-4c60-ba18-de3c73c2a4e7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1095 microversion: 2.1 time: 0.071062 Aug 30 00:04:22.102471 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 515/1053] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:22 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:23.124486 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:23.125188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:23.132100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:23.132661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:23.133100 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:23.133834 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:23.134293 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:23.134719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:23.198680 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:23.206781 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-bb447ba0-2ad1-4b80-8cb1-fbf964481d10 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1145 microversion: 2.1 time: 0.087832 Aug 30 00:04:23.207611 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 539/1054] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:23 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:24.227616 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:24.228226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:24.234918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:24.235400 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:24.235831 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:24.236586 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:24.237020 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:24.237429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:24.303143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:24.311509 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2b6f790c-63a0-40e7-8e16-a04660498fd1 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1193 microversion: 2.1 time: 0.087095 Aug 30 00:04:24.312349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 516/1055] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:24 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:25.334829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:25.335386 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:25.345522 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.352558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.352558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.352558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.352558 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.352951 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.506462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:25.515204 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0a261a40-5483-43d5-85af-be03b97c7c07 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1279 microversion: 2.1 time: 0.185000 Aug 30 00:04:25.515802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 540/1056] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:25 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:26.182012 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80666307-d0f2-45ea-8d85-c256c8f65841", "tag": "4854ce64-ea30-4f58-b30f-1110cea9fcea"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:26.193496 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.193973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.195030 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.206680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] Creating event network-changed:4854ce64-ea30-4f58-b30f-1110cea9fcea for instance 80666307-d0f2-45ea-8d85-c256c8f65841 on hv-cinder-85504 Aug 30 00:04:26.212331 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-cbf61975-bd77-47ba-98e4-c1a5e7dd5d64 req-fbd79500-1e16-4820-94f1-080430055c49 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034062 Aug 30 00:04:26.212960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 517/1057] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:26.536203 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:26.536862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:26.543170 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.543654 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.544206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.544813 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.545804 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.546531 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.684949 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:26.693560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c8cd0e3b-8961-4763-9436-9ceaa2116b78 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.161324 Aug 30 00:04:26.697923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 541/1058] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:26 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:27.715366 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:27.716048 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:27.723504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.723984 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.724439 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.725117 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.725563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.725980 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.858547 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:27.866976 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d1812ea0-4e9d-434f-8c4c-2b3d50b1dbd9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.155733 Aug 30 00:04:27.867553 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 518/1059] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:27 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:28.887780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:28.888412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:28.895542 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.896020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.896491 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.897184 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.897640 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.898064 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:29.030495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:29.038205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c0b2d43f-a8d1-4712-a0c1-bad9f83413ba tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.154420 Aug 30 00:04:29.038774 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 542/1060] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:28 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:30.058997 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:30.059637 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:30.066328 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:30.066817 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:30.067254 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:30.067948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:30.068448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:30.068916 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:30.205287 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:30.213166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3af0658-8101-40df-b6c5-a3e52b4816af tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.158092 Aug 30 00:04:30.213706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 519/1061] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:30 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:31.235190 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:31.235802 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:31.242192 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.242669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.243114 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.243798 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.244277 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.244691 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.378694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:31.386396 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-efee46e1-0057-49fc-a505-0827c7fa27e5 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.156133 Aug 30 00:04:31.386961 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 543/1062] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:31 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:32.408336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:32.408919 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:32.411251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:32.416023 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.419154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.419154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.419154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.419154 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.419613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.552504 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:32.560071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10d8ab52-e8e5-4525-8ec0-88b5e0c578d4 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.156492 Aug 30 00:04:32.560725 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 520/1063] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:32 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:33.581420 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:33.581974 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:33.584020 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:33.584742 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=6 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:33.589989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.590490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.590909 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.591601 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.592663 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.596040 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.725306 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:33.733198 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-556dd3b9-56af-4756-84a9-249f4c01c95f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.155872 Aug 30 00:04:33.733722 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 544/1064] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:33 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:34.754645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:34.755872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:34.761887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.762446 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.762875 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.763569 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.764833 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.765483 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.901026 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:34.909256 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dfdf135c-705e-498c-b191-8554ffb0011b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.158636 Aug 30 00:04:34.909911 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 521/1065] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:34 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:35.930703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:35.931303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:35.938666 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.939144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.939570 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:35.940288 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.940740 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.941156 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:36.080354 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:36.088769 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-39a24e47-78be-4b27-86ac-8c367299d888 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.161958 Aug 30 00:04:36.089353 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 545/1066] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:35 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:36.559590 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80666307-d0f2-45ea-8d85-c256c8f65841", "name": "network-vif-plugged", "status": "completed", "tag": "4854ce64-ea30-4f58-b30f-1110cea9fcea"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:36.571013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:36.571013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:36.571013 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:36.584295 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] Creating event network-vif-plugged:4854ce64-ea30-4f58-b30f-1110cea9fcea for instance 80666307-d0f2-45ea-8d85-c256c8f65841 on hv-cinder-85504 Aug 30 00:04:36.592459 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-4d349fb8-8051-4971-8309-8e651a1ceddb req-513d2c39-e534-40c3-9b10-8a1da54b792c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093822 Aug 30 00:04:36.593521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 522/1067] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:37.111189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:37.111845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:37.118278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:37.118784 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:37.119211 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:37.119976 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:37.120410 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:37.120830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:37.259251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:37.268022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2a5f42eb-cf71-49d0-a256-fb854f873a5b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1267 microversion: 2.1 time: 0.161761 Aug 30 00:04:37.268643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 546/1068] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:37 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:38.290709 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:38.291322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:38.298743 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.299231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.299661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.300449 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.300907 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.301328 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.440780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:38.448480 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ea550104-7164-49bc-b115-e57d717a6f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1454 microversion: 2.1 time: 0.162666 Aug 30 00:04:38.449041 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 523/1069] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:38 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:38.469275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:38.469886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:38.476361 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.476849 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.477289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.477983 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.478442 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.478869 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.610189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:38.617959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-e2e89acb-25ab-4eee-9f78-9a802bab1e8b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1454 microversion: 2.1 time: 0.153094 Aug 30 00:04:38.618525 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 547/1070] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:38 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:40.897222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80666307-d0f2-45ea-8d85-c256c8f65841", "tag": "4854ce64-ea30-4f58-b30f-1110cea9fcea"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:40.907751 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:40.908249 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:40.908674 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:40.921179 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] Creating event network-changed:4854ce64-ea30-4f58-b30f-1110cea9fcea for instance 80666307-d0f2-45ea-8d85-c256c8f65841 on hv-cinder-85504 Aug 30 00:04:40.926335 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-88c3708b-8dee-44f9-a4d2-1e2a2dd272a1 req-6621650b-4e19-457d-bd49-869fa5a4e22a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032792 Aug 30 00:04:40.933331 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 524/1071] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:46.743749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:46.744365 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:46.746730 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:46.751652 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.756940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.756940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.756940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.756940 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.757379 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.757856 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=77 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:46.777727 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lazy-loading 'flavor' on Instance uuid 00a1abe8-ac53-4188-a0ef-b087cec70b75 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:47.018861 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d812c764-f989-4a30-a50e-34d67495edc0 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "POST /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75/action" status: 202 len: 0 microversion: 2.1 time: 0.278870 Aug 30 00:04:47.019370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 548/1072] 10.222.0.90 () {60 vars in 1278 bytes} [Tue Aug 30 00:04:46 2022] POST /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:04:47.029514 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:47.030276 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:47.032203 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:47.037365 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.042525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.042525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:47.042525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.042525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.043025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:47.043025 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:47.183745 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:47.192071 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aa775c0b-2c87-4b80-a13b-c61a13825dce tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.168036 Aug 30 00:04:47.192685 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 525/1073] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:47 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:48.214431 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:48.215046 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:48.221958 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:48.222471 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:48.222911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:48.223608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:48.224065 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:48.224514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:48.360705 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:48.368499 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-9985f435-c0c2-4a3a-ac17-6ff95dd9785d tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.158813 Aug 30 00:04:48.369087 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 549/1074] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:48 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:49.390032 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:49.390585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:49.397629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.398111 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.398546 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:49.399234 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.399770 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.400218 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:49.532028 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:49.539771 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5f5c3a0c-de36-4b7b-a419-35d59aa50388 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.154363 Aug 30 00:04:49.540376 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 526/1075] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:49 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:50.563274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:50.563881 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:50.570004 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:50.570484 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:50.570922 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.571599 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:50.572055 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:50.572512 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.704970 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:50.713076 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-353c1d05-8b91-42cf-96fe-c1459dd421ff tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.154692 Aug 30 00:04:50.713644 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 550/1076] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:50 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:51.735022 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:51.735579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:51.742361 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.742864 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.743287 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.743974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.744444 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.744860 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.881198 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:51.889010 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d1ab042c-c70f-4590-a6c6-86b660ed934c tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.158346 Aug 30 00:04:51.889579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 527/1077] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:51 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:52.910647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:52.911369 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:52.917771 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.918253 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.918687 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:52.919887 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.920514 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.920882 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:53.053492 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:53.061505 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c07825d1-0115-42e1-82f3-cffb041d9628 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.154725 Aug 30 00:04:53.062072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 551/1078] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:52 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:54.083029 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:54.083657 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:54.090017 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:54.090522 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:54.090948 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:54.092930 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:54.093383 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:54.093802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:54.226306 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:54.234834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b99fa35a-2228-4e0d-bab4-65ff98dc66e1 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.155914 Aug 30 00:04:54.235399 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 528/1079] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:54 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:55.256072 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:55.256741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:55.263703 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:55.264300 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:55.264767 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:55.265473 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:55.265925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:55.266349 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:55.403609 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:55.411403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-c16e665d-f3f1-47f9-988a-3b367ab09e24 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.159259 Aug 30 00:04:55.411969 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 552/1080] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:55 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:56.432294 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:56.432905 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:56.439486 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:56.440987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:56.440987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:56.441214 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:56.441554 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:56.441978 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:56.578012 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:56.585947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ec8a0a48-387e-4156-9a2a-4042ec51d61b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.157590 Aug 30 00:04:56.586503 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 529/1081] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:56 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:57.607407 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:57.608029 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:57.614704 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:57.615189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:57.615628 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:57.616370 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:57.616829 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:57.617269 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:57.754980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:57.762914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-35cc9bb2-528d-40dc-9dc2-604ca3f59391 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.160000 Aug 30 00:04:57.763753 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 553/1082] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:57 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:58.784423 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:58.785035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:58.791635 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:58.792116 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:58.792576 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:58.793265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:58.793728 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:58.794672 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:58.928762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:58.937201 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d5392899-3762-4431-8dd9-130343eb0f07 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.156644 Aug 30 00:04:58.937780 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 530/1083] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:58 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:59.958248 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:59.963838 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:59.967038 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:59.967541 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:59.968261 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:59.968907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:59.969367 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:59.969796 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:00.101556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:00.110327 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-91eeaaf3-ea22-4380-88de-46e5dfdccbc8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.156365 Aug 30 00:05:00.111676 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 554/1084] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:59 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:01.132629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:01.133313 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:01.140512 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.141003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.141437 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.142126 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.142577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.142996 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.276887 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:01.285302 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c27f5e95-1fb1-4f5f-addc-cf5100083d3b tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1507 microversion: 2.1 time: 0.157115 Aug 30 00:05:01.285872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 531/1085] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:01 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:01.305859 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:01.306446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:01.313161 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.313647 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.314081 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.314817 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.315274 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.315704 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.346150 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127669) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:05:01.644099 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ddd87c01-0fe5-4949-b53c-d7c436ef8eb4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "POST /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75/action" status: 202 len: 0 microversion: 2.1 time: 0.342097 Aug 30 00:05:01.644728 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 555/1086] 10.222.0.90 () {60 vars in 1278 bytes} [Tue Aug 30 00:05:01 2022] POST /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:01.652812 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:01.654052 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:01.659973 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.660495 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.664034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.664034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.664034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.664034 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.795614 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:01.803658 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2c66d9cd-3670-4f45-8294-6d2319c43074 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1515 microversion: 2.1 time: 0.154609 Aug 30 00:05:01.804248 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 532/1087] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:01 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:02.541701 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "name": "network-vif-unplugged", "status": "completed", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:02.552706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:02.553187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:02.553621 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:02.565811 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.compute.server_external_events [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] Unable to find a host for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75. Dropping event network-vif-unplugged {{(pid=127669) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 00:05:02.567585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b0352f58-7b53-45e9-a9ee-6ba5b8f551ec req-6a4c8c75-b6ee-4804-8c8d-8dcba7db9ca9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029557 Aug 30 00:05:02.567585 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 556/1088] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 00:05:02.824927 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:02.825555 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:02.832623 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:02.833108 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:02.833532 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:02.834217 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:02.834661 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:02.835070 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:02.968591 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:02.975744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-09edab76-32d9-4598-835e-a3b889625e69 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1517 microversion: 2.1 time: 0.154662 Aug 30 00:05:02.976331 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 533/1089] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:02 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:03.998029 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:03.998921 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:04.005527 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.006006 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.006437 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.007132 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.007582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.008005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.145560 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:04.156415 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-b418220c-af2a-48c6-885e-0d137cb3bdd4 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1517 microversion: 2.1 time: 0.162296 Aug 30 00:05:04.157000 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 557/1090] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:03 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:05.177760 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:05.178393 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:05.184824 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.185298 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.185729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.186706 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.187163 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.187582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.318762 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:05.326645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bc26a9fe-52fb-452a-93df-5566dee4ea4f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.152655 Aug 30 00:05:05.327680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 534/1091] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:05 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:06.348810 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:06.349437 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:06.355931 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:06.356451 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:06.356886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:06.358083 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:06.358555 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:06.358984 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:06.502911 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:06.510712 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-150a5dda-711e-47fd-aad3-d31d8c80c2a6 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.165815 Aug 30 00:05:06.511281 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 558/1092] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:06 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:07.531583 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:07.532136 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:07.538510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:07.538991 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:07.539425 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:07.540110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:07.540589 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:07.541009 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:07.672652 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:07.680288 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a6842b73-8503-4fbc-8ab9-395bceccd7a5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.152792 Aug 30 00:05:07.680840 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 535/1093] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:07 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:08.701954 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:08.702764 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:08.709626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:08.710110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:08.710548 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:08.711289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:08.711749 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:08.712194 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:08.846971 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:08.854741 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f4bfa5ee-d0e1-462b-ae47-59f28981a067 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.156857 Aug 30 00:05:08.855310 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 559/1094] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:08 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:09.877872 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:09.878484 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:09.885185 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:09.885673 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:09.886107 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:09.886802 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:09.887260 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:09.887675 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:10.017803 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:10.025687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ea3d6731-cfc9-4299-a7d7-dd1e52e1041f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.152520 Aug 30 00:05:10.026261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 536/1095] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:09 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:11.046673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:11.047299 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:11.054036 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:11.054516 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:11.054943 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:11.055655 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:11.056105 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:11.056562 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:11.196483 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:11.205148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0aa98f18-b650-470c-9576-aeb5cbd312d2 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.162417 Aug 30 00:05:11.205723 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 560/1096] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:11 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:12.226413 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:12.227018 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:12.233969 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:12.234445 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:12.234877 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:12.235568 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:12.236019 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:12.236471 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:12.369629 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:12.378586 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7f084140-db55-46e4-99df-876062df7e97 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.156030 Aug 30 00:05:12.379398 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 537/1097] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:12 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:13.398862 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:13.399489 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:13.406607 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:13.407092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:13.407532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:13.408256 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:13.408706 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:13.409127 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:13.544892 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:13.552683 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-143820f7-7d56-42a8-b8b0-944b97817304 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.157700 Aug 30 00:05:13.553252 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 561/1098] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:13 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:14.574015 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:14.574625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:14.581617 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.582118 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.582809 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.583512 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.583964 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.584644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.613615 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "name": "network-vif-plugged", "status": "completed", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:14.624848 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.625356 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.625989 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.641623 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] Creating event network-vif-plugged:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:05:14.646799 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-8d2b79ed-3a6f-4c6d-8a4c-92a1c3cf1a0c req-b54f2d90-6e24-4dff-b967-d1d4647ec994 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037943 Aug 30 00:05:14.647462 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 562/1099] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:14.724732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:14.733645 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4558b5b5-e006-46e4-a74b-cc8c13f22ea5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.162733 Aug 30 00:05:14.746836 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 538/1100] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:14 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:15.755466 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:15.756206 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:15.762777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.763262 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.763697 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:15.764418 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.765556 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.765985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:15.768661 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:15.909449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:15.917261 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-13966426-a8bc-4040-b634-0e22f572bd68 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1573 microversion: 2.1 time: 0.165974 Aug 30 00:05:15.917840 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 563/1101] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:15 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:16.940160 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:16.940784 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:16.947114 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:16.947588 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:16.948014 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:16.948720 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:16.949169 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:16.949585 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.083607 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:17.091422 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-839401ca-09fc-4b69-9aab-e944087366ed tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1560 microversion: 2.1 time: 0.156232 Aug 30 00:05:17.091991 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 539/1102] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:16 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:20.615709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03383134-92a8-4577-a8f4-3047928d34b2] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 00:06:20.616567 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:20.617455 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=5 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:20.623643 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1527222998", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799128686", "security_groups": [{"name": "tempest-secgroup-smoke-1260045331"}], "block_device_mapping_v2": [{"uuid": "dbe82221-9681-4897-8b1b-bae429deb4c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79f758d9-f5c9-4dd1-ba1e-2857ef410b54"}]}} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:20.742326 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.network.neutron [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] validate_networks() for [('79f758d9-f5c9-4dd1-ba1e-2857ef410b54', None, None, None, None, None)] {{(pid=127669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:06:21.123449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:06:21.123886 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image limits 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:06:21.124412 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Flavor pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:06:21.124819 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Image pref 0:0:0 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:06:21.125364 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.virt.hardware [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:06:21.134586 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:21.135096 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:21.135530 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:21.136294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:21.136761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:21.137188 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:21.155515 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:06:21.159506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.quota [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Getting quotas for user eb54f68dbdc845f3aeb0d1661f531a0d and project 6e1e7c36165f47ad838bb6b42f3179d9. Resources: {'ram', 'instances', 'cores'} {{(pid=127669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:06:21.216821 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Going to run 1 instances... {{(pid=127669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:06:21.218918 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbe82221-9681-4897-8b1b-bae429deb4c6',volume_size=None,volume_type=None)] {{(pid=127669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:06:21.627967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-34050be2-5e63-4739-a3db-28fd18fab347 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013992 Aug 30 00:06:21.628641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 564/1103] 10.222.0.90 () {60 vars in 1147 bytes} [Tue Aug 30 00:06:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:06:21.638396 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=29 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:21.639143 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=89 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:21.640197 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:06:21.640448 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Tue Aug 30 00:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 (ip 10.222.0.90) !!! Aug 30 00:06:21.645008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0a245f9e-47f0-491a-b466-8a70dbf510ef tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:21.645732 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0a245f9e-47f0-491a-b466-8a70dbf510ef tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:21.701955 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0a245f9e-47f0-491a-b466-8a70dbf510ef tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:21.709219 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0a245f9e-47f0-491a-b466-8a70dbf510ef tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1095 microversion: 2.1 time: 0.072646 Aug 30 00:06:21.709962 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 540/1104] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:21 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:22.730419 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:22.730967 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:22.738790 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:22.739267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:22.739695 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:22.740403 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:22.740999 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:22.741422 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:22.744963 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO oslo.messaging._drivers.impl_rabbit [-] [03383134-92a8-4577-a8f4-3047928d34b2] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 53998. Aug 30 00:06:22.804658 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:22.812812 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d2cd5fd3-81cf-45cc-bb9b-6bcdb10dffe7 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1137 microversion: 2.1 time: 0.087274 Aug 30 00:06:22.813625 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 565/1105] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:22 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:23.836027 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:23.836694 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:23.845430 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:23.845920 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:23.846539 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:23.847243 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:23.847704 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:23.848123 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:23.958843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:23.958843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ee115d65-703f-41c9-830c-c768b84aa5d9 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1211 microversion: 2.1 time: 0.099899 Aug 30 00:06:23.958843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 541/1106] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:23 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:24.952446 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:24.953148 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:24.959891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:24.960436 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:24.960877 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:24.961602 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:24.962042 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:24.962465 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:25.105814 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:25.114345 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4d62536c-106f-4d3a-9b7b-923a69ae374f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1279 microversion: 2.1 time: 0.165923 Aug 30 00:06:25.115092 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 566/1107] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:24 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:25.508550 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5d6cce-0131-45c1-bfcd-a66adba76c95", "tag": "abe29c2e-86d6-4583-9a88-dd72f841e7b5"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:25.520870 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:25.522066 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:25.522752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:25.536077 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] Creating event network-changed:abe29c2e-86d6-4583-9a88-dd72f841e7b5 for instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 on hv-cinder-85504 Aug 30 00:06:25.541947 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-1edd2239-422d-47da-b4ce-cdd6790de85e req-3dc40a58-3841-4e16-93da-8af956d8e027 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037267 Aug 30 00:06:25.543680 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 542/1108] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:26.135005 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:26.135914 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:26.143789 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:26.144275 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:26.144720 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:26.145433 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:26.145925 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:26.146355 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:26.278259 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:26.286061 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-443bfb75-ee6e-4343-952e-b82946b52aad tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.154919 Aug 30 00:06:26.286645 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 567/1109] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:26 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:27.308201 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:27.309216 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:27.316300 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:27.316792 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:27.317226 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:27.317963 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:27.318467 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:27.318914 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:27.458889 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:27.467450 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-745f815e-038f-4609-8c04-379b413b690d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.163522 Aug 30 00:06:27.468021 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 543/1110] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:27 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:28.488052 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:28.488747 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:28.495251 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:28.495732 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:28.497053 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:28.497754 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:28.498205 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:28.498626 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:28.630441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:28.638591 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6686e007-e616-4040-bb5e-1fd31e6c5fb2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.154364 Aug 30 00:06:28.639187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 568/1111] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:28 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:29.659438 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:29.660087 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:29.666259 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.666754 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.668350 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.668350 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.668687 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.669100 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.802804 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:29.812192 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f29fbd6b-1016-4ad8-8cec-bffc8e3429d0 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.156819 Aug 30 00:06:29.812806 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 544/1112] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:29 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:30.833679 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:30.834232 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:30.840904 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.841393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.841830 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:30.842526 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.842985 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.843408 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:30.976449 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:30.984711 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-6b1ab130-5972-4a80-9c59-fb952fc28138 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.155248 Aug 30 00:06:30.985291 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 569/1113] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:30 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:32.007043 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:32.007603 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:32.010056 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:32.015521 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:32.016008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:32.016481 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:32.017196 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:32.017638 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:32.018702 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:32.157699 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:32.165600 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2871592c-3dbf-4a43-a6d3-ffa73569266e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.162613 Aug 30 00:06:32.168433 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 545/1114] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:32 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:33.187357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:33.188138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:33.189909 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=2 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:33.190593 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell0:SELECT=6 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:33.198853 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:33.201263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:33.201263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:33.201482 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:33.201888 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:33.202305 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:33.467721 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:33.475694 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-2d4e5ec8-f2bb-4e02-b202-1ef3be06bf79 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.293274 Aug 30 00:06:33.489670 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 570/1115] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:33 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:34.062124 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:34.063261 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:34.069987 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.070467 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.071063 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.071944 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.072417 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.072838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.101776 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:06:34.130980 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:34.144690 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.144690 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.144690 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.155278 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] Creating event network-changed:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:06:34.160582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-b2dbe5a7-6688-4132-a1fc-7d17d7d0c687 req-01bee742-24b9-47d9-802a-b327becacf16 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101391 Aug 30 00:06:34.161189 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 571/1116] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:34.384626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f4387e9a-451a-4de3-9682-e68b1b4dd26f tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "DELETE /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 204 len: 0 microversion: 2.1 time: 0.327586 Aug 30 00:06:34.388044 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 546/1117] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:34 2022] DELETE /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:06:34.396494 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:34.397552 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:34.405843 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.406524 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.407136 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.407871 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.408438 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.408919 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.498954 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:34.499772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:34.506167 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.506669 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.507109 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.507811 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.508492 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.508918 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.569979 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:34.579434 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-1415105f-6899-4e28-b390-d1006b7a258e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.188104 Aug 30 00:06:34.580906 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 572/1118] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:34 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:34.659304 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:34.667377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-664b6f61-c0ea-431b-bc2d-04611adac945 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.173544 Aug 30 00:06:34.667959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 547/1119] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:34 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:35.122441 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5d6cce-0131-45c1-bfcd-a66adba76c95", "name": "network-vif-plugged", "status": "completed", "tag": "abe29c2e-86d6-4583-9a88-dd72f841e7b5"}]} {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:35.132608 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.133085 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.133511 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.145144 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.compute.server_external_events [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] Creating event network-vif-plugged:abe29c2e-86d6-4583-9a88-dd72f841e7b5 for instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 on hv-cinder-85504 Aug 30 00:06:35.149962 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [req-11d44c0f-40fd-4adc-a195-cb88247a3858 req-fb47621c-e15e-438e-9eaa-fca592074bc8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Aug 30 00:06:35.150554 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 573/1120] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:35.602515 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:35.603119 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:35.610305 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.610909 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.611346 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.612083 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.612563 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.614265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.689409 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:35.690263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:35.696959 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.697453 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.697896 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.698604 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.699062 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.699532 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.791729 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:35.802843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3c91d3a6-6e50-4fb6-b355-3769ecfe922e tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1566 microversion: 2.1 time: 0.201046 Aug 30 00:06:35.802843 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 548/1121] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:35 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:35.908289 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:35.916097 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-19b48ae0-5458-4caf-b0e9-ab8ad463b5de tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.231535 Aug 30 00:06:35.916993 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 574/1122] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:35 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:36.649507 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1abe8-ac53-4188-a0ef-b087cec70b75", "name": "network-vif-deleted", "tag": "b23f7177-0e8e-4fff-b079-7a4f5edcff57"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:36.659959 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:36.660473 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:36.660956 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:36.672404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] Creating event network-vif-deleted:b23f7177-0e8e-4fff-b079-7a4f5edcff57 for instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 on hv-cinder-85504 Aug 30 00:06:36.677227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-89736382-899c-4eea-b92e-65e14aa2cfa2 req-97b59670-c8a0-4b4c-8637-256a1040ed5c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Aug 30 00:06:36.677814 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 549/1123] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:36.821357 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:36.821948 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:36.828435 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:36.828924 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:36.829374 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:36.830126 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:36.830592 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:36.831019 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:36.898126 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:36.906662 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-4290cb00-3188-4680-8f00-b067e54f87e8 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1217 microversion: 2.1 time: 0.089251 Aug 30 00:06:36.907257 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 575/1124] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:36 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:36.997881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:36.998800 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:37.005349 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:37.005826 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:37.006250 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:37.006937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:37.007391 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:37.007807 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:37.149238 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:37.158327 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-471c6b70-591b-47fc-bf61-fa49427b0b1e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1267 microversion: 2.1 time: 0.223945 Aug 30 00:06:37.158898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 550/1125] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:36 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:37.928495 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:37.929143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:37.936209 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:37.936719 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:37.937160 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:37.937874 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:37.938333 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:37.938761 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:37.972696 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:37.973182 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:37.973622 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:37.974152 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.objects.instance [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lazy-loading 'fault' on Instance uuid 00a1abe8-ac53-4188-a0ef-b087cec70b75 {{(pid=127669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:06:38.019185 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d056d23a1a041f99c0afcc45fef323b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d9f13fb1af4c3a911d91561bf0aae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:38.027013 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f8e2cafa-a750-433d-9419-bd2e2702ac87 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 200 len: 1222 microversion: 2.1 time: 0.102496 Aug 30 00:06:38.027582 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 576/1126] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:37 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:38.178785 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:38.179344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:38.186265 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.186769 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.187200 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.187896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.188377 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.188794 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.324848 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:38.333607 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e8e61428-5829-45a8-b96c-2bc97acfda0a tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1453 microversion: 2.1 time: 0.158693 Aug 30 00:06:38.334174 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 551/1127] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:38 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:38.354294 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:38.354891 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:38.362170 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.362652 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.363079 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.363766 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.364236 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.364654 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.506141 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:38.515034 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-90a7c2fe-bec8-4bf5-9181-acd03bb78f7f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1453 microversion: 2.1 time: 0.164487 Aug 30 00:06:38.520111 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 577/1128] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:38 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:39.048974 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:39.049622 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] [instance: 00a1abe8-ac53-4188-a0ef-b087cec70b75] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:39.055543 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.056061 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.056530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.057231 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.057690 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.058150 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.072315 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] HTTP exception thrown: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Request method failure captured: Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 HTTP/1.1 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVN5_XqWtYipbFAFK7BGIc4lpaVXkRxeOxFWBo30RnyqP_-ud2zBaymFlQ8pDQviYmk__NaLO1P8ct8BTU5lMrQCDpH4vkzizP3nMQV4zkUr-neeqjhK5zTyUm4-A40fr3OhrjT4amcOD-Bqqh4lARvWTEhNoTJh-ApIqt_-iPbKrHw Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 25d9f13fb1af4c3a911d91561bf0aae5 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestShelveInstance-1816803548 Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:06:39.073995 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/25d9f13fb1af4c3a911d91561bf0aae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/25d9f13fb1af4c3a911d91561bf0aae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_25d9f13fb1af4c3a911d91561bf0aae5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/25d9f13fb1af4c3a911d91561bf0aae5"}]}] Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestShelveInstance-1816803548 Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 25d9f13fb1af4c3a911d91561bf0aae5 Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestShelveInstance-1816803548 Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestShelveInstance-1816803548-project Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: 9d056d23a1a041f99c0afcc45fef323b Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestShelveInstance-1816803548-project Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. Aug 30 00:06:39.076475 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '00a1abe8-ac53-4188-a0ef-b087cec70b75'} Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:39.077626 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. Aug 30 00:06:39.079336 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.081003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Returning 404 to user: Instance 00a1abe8-ac53-4188-a0ef-b087cec70b75 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:39.081003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1b882304-2eae-45bb-b022-3525a0bec7e5 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75" status: 404 len: 111 microversion: 2.1 time: 0.030452 Aug 30 00:06:39.081003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 552/1129] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:39 2022] GET /compute/v2.1/servers/00a1abe8-ac53-4188-a0ef-b087cec70b75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:39.315128 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-324ad9a1-8f62-4dd7-9625-3925ea6b8332 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] Calling method '.version_select at 0x7fd5a6661430>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:39.407936 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-324ad9a1-8f62-4dd7-9625-3925ea6b8332 tempest-TestShelveInstance-1816803548 tempest-TestShelveInstance-1816803548-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615395356" status: 202 len: 0 microversion: 2.1 time: 0.097377 Aug 30 00:06:39.408669 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 578/1130] 10.222.0.90 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615395356 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:06:40.558752 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5d6cce-0131-45c1-bfcd-a66adba76c95", "tag": "abe29c2e-86d6-4583-9a88-dd72f841e7b5"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:40.593227 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:40.593520 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:40.595952 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:40.625426 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] Creating event network-changed:abe29c2e-86d6-4583-9a88-dd72f841e7b5 for instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 on hv-cinder-85504 Aug 30 00:06:40.632247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ed8b49c8-33cf-49ae-ae3b-bcdd55019c8c req-59f62649-703b-488b-9363-570faf0589b7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074826 Aug 30 00:06:40.632247 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 553/1131] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:11.039506 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_cell1:SELECT=74 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:11.043625 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:11.044395 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:11.045421 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:08:11.045561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Tue Aug 30 00:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Aug 30 00:08:11.046519 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG dbcounter [-] [127669] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:11.052220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:11.054039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:11.060772 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5d6cce-0131-45c1-bfcd-a66adba76c95", "tag": "abe29c2e-86d6-4583-9a88-dd72f841e7b5"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:11.062273 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:11.062777 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:11.063210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:11.064002 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:11.064490 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:11.064916 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:11.071530 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:11.071748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:11.072144 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:11.090510 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] Creating event network-changed:abe29c2e-86d6-4583-9a88-dd72f841e7b5 for instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 on hv-cinder-85504 Aug 30 00:08:11.096582 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-6768e535-ad66-40cc-a853-56a9d18b716e req-c12f0251-5ab1-4a08-b919-41dd1b08887d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054864 Aug 30 00:08:11.097406 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 554/1132] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:11.101487 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:08:11.491566 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a0292a34-0cc2-43f5-b0e1-de18dba96e7e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 204 len: 0 microversion: 2.1 time: 0.453982 Aug 30 00:08:11.492803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 579/1133] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:08:11 2022] DELETE /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:08:11.503251 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:11.503960 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:11.512297 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:11.518886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:11.518886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:11.518886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:11.518886 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:11.519318 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:11.868838 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:11.877641 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a4497b8b-b5f9-4bea-a360-d929c5b6e056 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1578 microversion: 2.1 time: 0.379715 Aug 30 00:08:11.878222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 555/1134] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:11 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1578 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:12.899363 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:12.900039 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:12.906467 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:12.906950 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:12.907932 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:12.908758 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:12.909216 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:12.909664 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:13.102444 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:13.111187 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-97eb642f-ecfa-4dfc-9eb4-9b1692b2b80c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1459 microversion: 2.1 time: 0.215399 Aug 30 00:08:13.111957 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 580/1135] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:12 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1459 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:13.566898 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5d6cce-0131-45c1-bfcd-a66adba76c95", "name": "network-vif-deleted", "tag": "abe29c2e-86d6-4583-9a88-dd72f841e7b5"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:13.577211 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:13.577684 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:13.578103 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:13.590414 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] Creating event network-vif-deleted:abe29c2e-86d6-4583-9a88-dd72f841e7b5 for instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 on hv-cinder-85504 Aug 30 00:08:13.596326 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-43558036-7c36-4845-964b-ef02cc5ee403 req-2be22987-82f8-4d2f-b01f-37cf956d12f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Aug 30 00:08:13.597080 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 556/1136] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:14.132780 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:14.133393 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:14.140022 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:14.140577 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:14.141014 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:14.141709 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:14.142183 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:14.142605 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:14.205684 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:14.214547 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-f021b317-8419-42e2-9cff-09a6121b270b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 200 len: 1226 microversion: 2.1 time: 0.085629 Aug 30 00:08:14.215137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 581/1137] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:14 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:15.236206 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:15.236896 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 0c5d6cce-0131-45c1-bfcd-a66adba76c95] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:15.243552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:15.244035 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:15.244498 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:15.245187 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:15.245643 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:15.246069 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:15.259881 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] HTTP exception thrown: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Request method failure captured: Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 HTTP/1.1 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVNZjscV9Od6BGW2t-Gw2pig4Mxjdlw_52oVapu5etQoT_t9_oJeNINBIjEopkoJFu_hQ03o_ZRaYvRCXePozz7ghngNIOSS_3bcS4aepvDv1CWGKoYuuZjx5e4h5RMbLf5G5EH9vDnbp-dgsPPFoSUEtcIAFzY06UQ4uDiOMO9GOPI Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:08:15.261552 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6e1e7c36165f47ad838bb6b42f3179d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}] Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: eb54f68dbdc845f3aeb0d1661f531a0d Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. Aug 30 00:08:15.263404 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '0c5d6cce-0131-45c1-bfcd-a66adba76c95'} Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:08:15.264566 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. Aug 30 00:08:15.266330 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:15.268933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Returning 404 to user: Instance 0c5d6cce-0131-45c1-bfcd-a66adba76c95 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:08:15.268933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2f76ed28-99e8-4a3c-8fec-0618909e90a8 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95" status: 404 len: 111 microversion: 2.1 time: 0.030986 Aug 30 00:08:15.268933 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 557/1138] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:15 2022] GET /compute/v2.1/servers/0c5d6cce-0131-45c1-bfcd-a66adba76c95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:08:18.892110 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:18.892923 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:18.894367 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80666307-d0f2-45ea-8d85-c256c8f65841", "tag": "4854ce64-ea30-4f58-b30f-1110cea9fcea"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:18.900197 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:18.900686 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:18.901112 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:18.901803 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:18.902249 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:18.902920 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:18.904823 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:18.905579 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:18.906244 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:18.918429 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] Creating event network-changed:4854ce64-ea30-4f58-b30f-1110cea9fcea for instance 80666307-d0f2-45ea-8d85-c256c8f65841 on hv-cinder-85504 Aug 30 00:08:18.923501 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-f7b90bf2-a025-407a-8976-69cea387269d req-8809dbaa-2974-4de1-a5d2-40e03d2c8584 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Aug 30 00:08:18.924525 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 558/1139] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:18.931303 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Going to try to terminate instance {{(pid=127669) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:08:19.335195 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-d5ef39cc-bbc5-4d6a-9215-cff7fc889422 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "DELETE /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 204 len: 0 microversion: 2.1 time: 0.446881 Aug 30 00:08:19.336134 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 582/1140] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:08:18 2022] DELETE /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:08:19.345834 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:19.348837 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:19.353078 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:19.353805 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:19.354293 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:19.355115 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:19.355577 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:19.356003 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:19.504689 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:19.513008 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6c9c8b97-15fc-40c1-aa2f-15176b09317f tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1579 microversion: 2.1 time: 0.171530 Aug 30 00:08:19.513660 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 559/1141] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:19 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:20.536549 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:20.537234 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:20.543641 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:20.544120 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:20.544576 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:20.545267 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:20.545775 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:20.546210 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:20.696440 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:20.704445 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-0b191216-a457-4937-9891-cb0e085d895d tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1460 microversion: 2.1 time: 0.172825 Aug 30 00:08:20.704953 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 583/1142] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:20 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1460 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:21.412303 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80666307-d0f2-45ea-8d85-c256c8f65841", "name": "network-vif-deleted", "tag": "4854ce64-ea30-4f58-b30f-1110cea9fcea"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:21.422348 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:21.423029 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:21.423308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:21.435110 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] Creating event network-vif-deleted:4854ce64-ea30-4f58-b30f-1110cea9fcea for instance 80666307-d0f2-45ea-8d85-c256c8f65841 on hv-cinder-85504 Aug 30 00:08:21.439951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-372263f4-cc66-413e-8c70-38cfefa9c9ff req-2287414a-657a-4c2e-b296-f615eebdfe62 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031388 Aug 30 00:08:21.440644 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 560/1143] 10.222.0.90 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:21.726138 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:21.726745 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:21.733398 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:21.737028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:21.737028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:21.737028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:21.737028 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:21.737637 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:21.803137 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.policy [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb54f68dbdc845f3aeb0d1661f531a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e7c36165f47ad838bb6b42f3179d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127669) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:21.812125 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-a0b4f53d-c733-4ca2-ad69-9433f1f0c53b tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 200 len: 1226 microversion: 2.1 time: 0.089796 Aug 30 00:08:21.819946 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 584/1144] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:21 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:22.834917 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:22.835613 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 80666307-d0f2-45ea-8d85-c256c8f65841] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:22.841787 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:22.842272 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:22.842712 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:22.843432 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:22.843858 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:22.844308 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:22.857334 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] HTTP exception thrown: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Request method failure captured: Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 HTTP/1.1 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVNZjscV9Od6BGW2t-Gw2pig4Mxjdlw_52oVapu5etQoT_t9_oJeNINBIjEopkoJFu_hQ03o_ZRaYvRCXePozz7ghngNIOSS_3bcS4aepvDv1CWGKoYuuZjx5e4h5RMbLf5G5EH9vDnbp-dgsPPFoSUEtcIAFzY06UQ4uDiOMO9GOPI Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:08:22.858951 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6e1e7c36165f47ad838bb6b42f3179d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}] Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: eb54f68dbdc845f3aeb0d1661f531a0d Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. Aug 30 00:08:22.860561 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '80666307-d0f2-45ea-8d85-c256c8f65841'} Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:08:22.861506 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. Aug 30 00:08:22.863381 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:22.865344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Returning 404 to user: Instance 80666307-d0f2-45ea-8d85-c256c8f65841 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:08:22.865344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-de8a3707-8f25-4b61-bbfa-3811be92711e tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841" status: 404 len: 111 microversion: 2.1 time: 0.031049 Aug 30 00:08:22.865344 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 561/1145] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:22 2022] GET /compute/v2.1/servers/80666307-d0f2-45ea-8d85-c256c8f65841 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:08:23.371317 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:23.371995 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.compute.api [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127669) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:23.378260 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:23.378795 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:23.379220 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:23.379907 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:23.380401 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:23.380827 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG oslo_concurrency.lockutils [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:23.394673 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.wsgi [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] HTTP exception thrown: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Request method failure captured: Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: request: DELETE /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 HTTP/1.1 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept: application/json Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Accept-Encoding: identity Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Connection: close Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Length: 0 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Content-Type: application/json Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Host: 10.222.0.90 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: Openstack-System-Scope: None Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: User-Agent: python-urllib3/1.26.12 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Auth-Token: gAAAAABjDVNZjscV9Od6BGW2t-Gw2pig4Mxjdlw_52oVapu5etQoT_t9_oJeNINBIjEopkoJFu_hQ03o_ZRaYvRCXePozz7ghngNIOSS_3bcS4aepvDv1CWGKoYuuZjx5e4h5RMbLf5G5EH9vDnbp-dgsPPFoSUEtcIAFzY06UQ4uDiOMO9GOPI Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Id: None Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Domain-Name: None Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Identity-Status: Confirmed Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Is-Admin-Project: True Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Id: default Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Domain-Name: Default Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Project-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Role: member,reader Aug 30 00:08:23.396387 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Roles: member,reader Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6e1e7c36165f47ad838bb6b42f3179d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}] Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-Tenant-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Id: default Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Domain-Name: Default Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Id: eb54f68dbdc845f3aeb0d1661f531a0d Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: X-User-Name: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: method: > Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: exception: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.398143 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: action_args: {'id': '15195999-d4a4-4d69-a4f5-385d63adc174'} Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:08:23.399162 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.400844 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.402633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Returning 404 to user: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. {{(pid=127669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:08:23.402633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-86ff5672-b3a4-4f8b-ac28-9d1a7b0c4482 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "DELETE /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 404 len: 111 microversion: 2.1 time: 0.030518 Aug 30 00:08:23.402633 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 585/1146] 10.222.0.90 () {58 vars in 1239 bytes} [Tue Aug 30 00:08:23 2022] DELETE /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:08:23.406701 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:23.407301 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] [instance: 15195999-d4a4-4d69-a4f5-385d63adc174] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:23.414267 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:23.414741 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:23.415166 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:23.415848 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Acquiring lock "e9efe90b-fc44-4963-9806-066476515edb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:23.416322 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:23.416744 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Lock "e9efe90b-fc44-4963-9806-066476515edb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:23.430620 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] HTTP exception thrown: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Request method failure captured: Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 HTTP/1.1 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept: application/json Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Connection: close Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Length: 0 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Content-Type: application/json Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Host: 10.222.0.90 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjDVNZjscV9Od6BGW2t-Gw2pig4Mxjdlw_52oVapu5etQoT_t9_oJeNINBIjEopkoJFu_hQ03o_ZRaYvRCXePozz7ghngNIOSS_3bcS4aepvDv1CWGKoYuuZjx5e4h5RMbLf5G5EH9vDnbp-dgsPPFoSUEtcIAFzY06UQ4uDiOMO9GOPI Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Role: member,reader Aug 30 00:08:23.432142 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Roles: member,reader Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6e1e7c36165f47ad838bb6b42f3179d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6e1e7c36165f47ad838bb6b42f3179d9"}]}] Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e1e7c36165f47ad838bb6b42f3179d9 Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestVolumeBootPattern-1925969706 Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Id: eb54f68dbdc845f3aeb0d1661f531a0d Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestVolumeBootPattern-1925969706-project Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: method: > Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: exception: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.433937 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: action_args: {'id': '15195999-d4a4-4d69-a4f5-385d63adc174'} Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:08:23.435092 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. Aug 30 00:08:23.436748 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Aug 30 00:08:23.438222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Returning 404 to user: Instance 15195999-d4a4-4d69-a4f5-385d63adc174 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:08:23.438222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6ad36a90-89c0-4e9c-8d0e-14d76ac449a2 tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174" status: 404 len: 111 microversion: 2.1 time: 0.030645 Aug 30 00:08:23.438222 dv-cinder-855041-2-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 562/1147] 10.222.0.90 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:23 2022] GET /compute/v2.1/servers/15195999-d4a4-4d69-a4f5-385d63adc174 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:08:24.976744 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: DEBUG nova.api.openstack.wsgi [None req-ea09b744-7f74-4b70-bcf4-4aafee91523c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] Calling method '.version_select at 0x7fd5a65bc1f0>' {{(pid=127669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:25.053263 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: INFO nova.api.openstack.requestlog [None req-ea09b744-7f74-4b70-bcf4-4aafee91523c tempest-TestVolumeBootPattern-1925969706 tempest-TestVolumeBootPattern-1925969706-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1799128686" status: 202 len: 0 microversion: 2.1 time: 0.081148 Aug 30 00:08:25.053845 dv-cinder-855041-2-iscsi devstack@n-api.service[127669]: [pid: 127669|app: 0|req: 586/1148] 10.222.0.90 () {58 vars in 1263 bytes} [Tue Aug 30 00:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1799128686 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)